-- Logs begin at Sat 2022-08-27 01:35:59 UTC, end at Sat 2022-08-27 02:34:45 UTC. -- Aug 27 02:11:59.166125 dv-cinder-846303-3-smb systemd[1]: Starting Devstack devstack@n-api.service... Aug 27 02:11:59.176161 dv-cinder-846303-3-smb devstack@n-api.service[105758]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 27 02:11:59.178609 dv-cinder-846303-3-smb devstack@n-api.service[105758]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Aug 27 02:11:59 2022] *** Aug 27 02:11:59.178609 dv-cinder-846303-3-smb devstack@n-api.service[105758]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 27 02:11:59.178609 dv-cinder-846303-3-smb devstack@n-api.service[105758]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 27 02:11:59.178609 dv-cinder-846303-3-smb devstack@n-api.service[105758]: nodename: dv-cinder-846303-3-smb Aug 27 02:11:59.178609 dv-cinder-846303-3-smb devstack@n-api.service[105758]: machine: x86_64 Aug 27 02:11:59.178609 dv-cinder-846303-3-smb devstack@n-api.service[105758]: clock source: unix Aug 27 02:11:59.178609 dv-cinder-846303-3-smb devstack@n-api.service[105758]: pcre jit disabled Aug 27 02:11:59.178609 dv-cinder-846303-3-smb devstack@n-api.service[105758]: detected number of CPU cores: 4 Aug 27 02:11:59.178609 dv-cinder-846303-3-smb devstack@n-api.service[105758]: current working directory: / Aug 27 02:11:59.178609 dv-cinder-846303-3-smb devstack@n-api.service[105758]: detected binary path: /usr/bin/uwsgi-core Aug 27 02:11:59.178609 dv-cinder-846303-3-smb devstack@n-api.service[105758]: your processes number limit is 47680 Aug 27 02:11:59.178609 dv-cinder-846303-3-smb devstack@n-api.service[105758]: your memory page size is 4096 bytes Aug 27 02:11:59.178609 dv-cinder-846303-3-smb devstack@n-api.service[105758]: detected max file descriptor number: 2048 Aug 27 02:11:59.178609 dv-cinder-846303-3-smb devstack@n-api.service[105758]: lock engine: pthread robust mutexes Aug 27 02:11:59.180970 dv-cinder-846303-3-smb devstack@n-api.service[105758]: thunder lock: enabled Aug 27 02:11:59.180970 dv-cinder-846303-3-smb devstack@n-api.service[105758]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 27 02:11:59.180970 dv-cinder-846303-3-smb devstack@n-api.service[105758]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 27 02:11:59.218003 dv-cinder-846303-3-smb devstack@n-api.service[105758]: Python main interpreter initialized at 0x55a7bda759c0 Aug 27 02:11:59.218003 dv-cinder-846303-3-smb devstack@n-api.service[105758]: python threads support enabled Aug 27 02:11:59.218003 dv-cinder-846303-3-smb devstack@n-api.service[105758]: your server socket listen backlog is limited to 100 connections Aug 27 02:11:59.218003 dv-cinder-846303-3-smb devstack@n-api.service[105758]: your mercy for graceful operations on workers is 90 seconds Aug 27 02:11:59.218457 dv-cinder-846303-3-smb devstack@n-api.service[105758]: mapped 403077 bytes (393 KB) for 2 cores Aug 27 02:11:59.218457 dv-cinder-846303-3-smb devstack@n-api.service[105758]: *** Operational MODE: preforking *** Aug 27 02:11:59.218709 dv-cinder-846303-3-smb devstack@n-api.service[105758]: *** uWSGI is running in multiple interpreter mode *** Aug 27 02:11:59.218709 dv-cinder-846303-3-smb devstack@n-api.service[105758]: spawned uWSGI master process (pid: 105758) Aug 27 02:11:59.218969 dv-cinder-846303-3-smb systemd[1]: Started Devstack devstack@n-api.service. Aug 27 02:11:59.219630 dv-cinder-846303-3-smb devstack@n-api.service[105758]: spawned uWSGI worker 1 (pid: 105759, cores: 1) Aug 27 02:11:59.220384 dv-cinder-846303-3-smb devstack@n-api.service[105758]: spawned uWSGI worker 2 (pid: 105760, cores: 1) Aug 27 02:11:59.220384 dv-cinder-846303-3-smb devstack@n-api.service[105758]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 27 02:11:59.902646 dv-cinder-846303-3-smb devstack@n-api.service[105760]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 27 02:11:59.904809 dv-cinder-846303-3-smb devstack@n-api.service[105759]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 27 02:12:01.021533 dv-cinder-846303-3-smb devstack@n-api.service[105759]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 02:12:01.021533 dv-cinder-846303-3-smb devstack@n-api.service[105759]: from cryptography.utils import int_from_bytes Aug 27 02:12:01.022346 dv-cinder-846303-3-smb devstack@n-api.service[105759]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 02:12:01.022346 dv-cinder-846303-3-smb devstack@n-api.service[105759]: from cryptography.utils import int_from_bytes Aug 27 02:12:01.024003 dv-cinder-846303-3-smb devstack@n-api.service[105760]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 02:12:01.024003 dv-cinder-846303-3-smb devstack@n-api.service[105760]: from cryptography.utils import int_from_bytes Aug 27 02:12:01.024469 dv-cinder-846303-3-smb devstack@n-api.service[105760]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 02:12:01.024469 dv-cinder-846303-3-smb devstack@n-api.service[105760]: from cryptography.utils import int_from_bytes Aug 27 02:12:03.597572 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 27 02:12:03.598161 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 27 02:12:03.598348 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 27 02:12:03.598687 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 27 02:12:03.598937 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 27 02:12:03.599317 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.599417 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 27 02:12:03.599767 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.599846 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 27 02:12:03.599919 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.600200 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 27 02:12:03.600308 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.600544 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.600680 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 27 02:12:03.600806 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 27 02:12:03.600895 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.601142 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.601250 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.601491 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.601596 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.601812 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.601906 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.602065 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.602160 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.602372 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.602466 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.602688 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846303-3-smb {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.602788 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.603005 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.603104 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.603304 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.603398 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.603604 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.603704 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.603912 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.604010 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.604207 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.604302 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.604522 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.604630 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846303-3-smb {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.604818 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.604918 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.605132 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.605334 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.605553 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.607273 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.607490 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.607679 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.607876 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.608065 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.608243 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.608243 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.608568 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.608568 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.608914 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.609140 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.609330 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.609527 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.609674 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.610243 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.610456 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.610837 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.611105 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.611393 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.611643 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.611913 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846303-3-smb {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.612110 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.612372 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.612733 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.613080 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.613287 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.613511 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.613712 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.613844 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.613967 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.614096 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.614222 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846303-3-smb {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.614380 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.614507 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.614507 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.614840 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.615030 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.615167 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.615167 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.615410 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.615410 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.615648 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.615797 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.615924 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.616080 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.616203 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.616384 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.616514 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.616514 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.616803 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.616937 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.617064 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.617190 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.617320 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.617468 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.617596 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.617725 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.617851 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.617976 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.618096 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.618221 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.618379 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.618537 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.618658 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.618784 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.618909 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.619032 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.619160 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.619287 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.619419 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.619545 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.619665 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.619789 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.619922 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.620048 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.620170 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.620295 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.620416 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.620550 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.620680 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.620802 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.620927 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.621047 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.621172 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.621309 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.621459 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.621591 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.621716 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.621842 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.621973 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.622098 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.622226 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.622345 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.622469 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.622579 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.622704 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.622829 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.622972 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.623167 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.623296 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.623495 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.623696 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.623887 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.624080 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.624209 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.61 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.624337 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.624466 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.61 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.624654 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.624841 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.625048 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.625233 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.625370 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.625618 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.625785 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.625968 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.626111 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.61 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.626272 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.626400 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.61 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.626530 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.626660 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.626787 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.626897 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.627007 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.627111 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.627225 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.627335 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.627438 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.627548 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.627652 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.627759 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.627877 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.627981 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.628092 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.628202 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.628306 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.628416 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.628530 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.628633 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.628745 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.628745 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.628945 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.629055 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.629157 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.629157 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.629284 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.629348 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.629433 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.629516 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.629583 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.629646 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.629708 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.629772 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.629845 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.629916 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.629987 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.630058 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.630123 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.630192 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.630257 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.630257 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.630915 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.631029 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.631141 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.631269 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.631403 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.631530 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.631635 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.631744 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.631853 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.631955 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.632065 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.632175 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.632285 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.632387 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.632515 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.632624 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.632742 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.632846 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.632959 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.633070 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.633196 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.633415 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.633907 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.634044 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.634173 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.634360 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.634609 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.634806 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.635001 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.635130 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.635251 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.635369 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.635499 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.635620 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.635746 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.635866 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.635984 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.636109 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.636228 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.636410 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.636770 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.636969 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.637164 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.637343 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.637662 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.637876 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.638102 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.638232 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.638434 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.638569 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.638816 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.639006 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.639222 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.639452 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.639578 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.639770 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.639950 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.640143 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.640332 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.640551 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.640793 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.640939 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.641205 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.641457 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.641638 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.641832 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.642099 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.642308 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.642510 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.642699 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.642887 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.643037 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.643236 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.643430 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.643704 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.643837 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.644018 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.644332 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.644465 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.644585 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.644803 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.645044 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.645231 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.645585 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.645847 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:12:03.646043 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.646241 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.646521 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.646888 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.647177 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.647471 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.648159 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.648432 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.648683 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.648856 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.649053 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.649240 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.649240 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.649792 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.650004 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.650004 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.650358 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.650485 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.650639 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.650834 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.650834 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.651085 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.651212 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.651212 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.651485 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.651621 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.651621 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.651863 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.651987 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.651987 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.652245 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.652368 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.652497 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.652658 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.652830 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.652961 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.652961 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.653205 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.653328 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.653539 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.653686 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.653922 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.654055 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.654055 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.654287 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.654416 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.654416 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.654416 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.654416 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.654416 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.654928 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.655033 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.655155 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.655286 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.655411 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.655533 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.655654 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.655774 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.655904 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.656040 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.656148 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.656271 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.656271 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.656505 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.656629 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.656771 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.656885 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.657009 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.657131 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.657252 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.657404 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.657544 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.657675 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.657798 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.657921 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.658043 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.658172 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.658297 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.658418 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.658546 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.658676 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.658798 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.658929 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.659052 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.659173 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.659294 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.659415 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.659536 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.659666 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.659797 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.659919 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.660042 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.660162 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.660295 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.660418 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.660544 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.660670 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.660792 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.660912 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.661117 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.661242 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.661365 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.661536 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.661651 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.661780 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.661912 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.662047 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.662177 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.662300 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.662421 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.662542 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.662672 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.662801 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.662924 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.663058 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.663183 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.663313 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.663444 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.663573 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.663707 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.663830 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.664044 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.664172 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.664297 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.664418 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.664539 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.664667 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.664800 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.664936 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.665059 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.665181 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.665304 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.665440 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.665568 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.665700 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.665824 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.665959 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.666089 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.666218 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.666349 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.666472 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.666601 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.666724 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.666845 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.666950 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.667080 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.667210 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.667319 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.667425 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.667530 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.667651 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.667790 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.667914 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.668036 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.668157 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.668279 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.668401 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.668531 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.668655 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.668767 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.668879 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.668986 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.669289 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.669460 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.669590 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.669714 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.669849 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.669973 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.670147 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.670281 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.670449 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.670575 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.670751 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.670880 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.671050 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.671189 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.671382 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.671494 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.671746 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.671871 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.671990 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.672097 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.672269 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.672491 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.672702 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.672837 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.672968 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.673099 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.673223 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.673345 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.673515 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.673662 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.673853 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.673989 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.674230 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.674351 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.674456 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.674571 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.674688 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.674795 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.675008 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.675146 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.675386 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.675524 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.675723 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.676041 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.676154 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.676359 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.676543 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.676687 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.676970 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.677095 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.677278 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.677619 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.677830 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.678029 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.678217 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.678416 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.678586 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.678752 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.678892 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.679116 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.679351 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.679546 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.679736 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.679923 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.680076 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.680331 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.680534 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.680719 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.680918 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.681097 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.681297 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.681588 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.681744 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.681898 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.682162 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.682366 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.682572 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.682761 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.682945 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.683115 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.683298 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.683496 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.683684 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.683878 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.684037 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.684312 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.684434 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.684592 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.684795 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.684997 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.685188 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.685380 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.685730 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.685943 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.686143 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.686342 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.686537 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.686738 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.686951 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.687155 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.687351 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.687542 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.687728 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.687931 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.688156 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.688318 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.688523 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.688687 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.688879 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.689067 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.689271 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.689493 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.689697 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.689910 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.690113 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.690323 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.690537 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.690740 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.690953 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.691154 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.691351 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.691663 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.691859 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.692062 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.692273 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.692474 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.692678 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.692880 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.693098 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.693301 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.693551 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.693754 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.693951 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.694148 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.694369 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.694651 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.694651 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.695012 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.695203 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.695406 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.695592 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.695790 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.695976 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.696158 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.696357 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.696566 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.696769 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.696967 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.697218 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.697477 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.697702 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.697920 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.698120 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.698324 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.698550 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.698751 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.698963 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.699162 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.699366 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.699542 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.699671 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.699794 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.699971 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.700163 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.700369 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.700567 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.700766 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.700976 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.701185 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.701384 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.701384 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.701842 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.702033 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.702234 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.702428 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.702634 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.702808 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.702929 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.703067 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.703275 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.703476 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.703750 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.703949 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.704164 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.704369 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.704593 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.704899 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.705103 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.705249 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.705385 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.705658 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.705866 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.706058 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.706257 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.706452 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.706648 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.706869 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.707066 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.707066 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.707451 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.707665 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.707865 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.708077 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.708263 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.708444 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.708651 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.708871 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.709067 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.709258 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.709444 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.709444 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.709761 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.709957 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.710155 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.710378 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.710516 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.710640 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.710811 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.711004 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.711227 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.711440 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.711440 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.711769 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.711979 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.712178 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.712385 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.712605 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.712791 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.712911 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.713032 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.713147 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.713267 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.713507 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.713663 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.713802 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.713897 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.713966 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.714041 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.714123 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.714247 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.714371 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.714498 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.714643 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.714796 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.714964 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.715101 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.715248 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.715395 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.715543 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.715543 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.715838 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.715979 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.716115 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.716253 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.716390 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.716548 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.716697 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.716845 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.716924 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.717004 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.717004 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.717175 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.717325 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.717513 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.717656 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.717800 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.717945 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.718089 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.718244 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.718390 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.718538 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.718683 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.718840 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.718986 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.719279 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.719421 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.719421 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.719685 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.719835 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.719968 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.720072 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.720155 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.720265 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.720406 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.720560 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.720720 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.720864 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.721007 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.721162 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.721307 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.721580 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.721801 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.721996 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.722199 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.722399 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.722610 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.722772 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.722916 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.723090 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.723296 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.723495 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.723688 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.723889 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.724105 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.724307 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.724500 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.724711 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.724918 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.725115 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.725299 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.725537 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.725740 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.725936 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.726063 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.726198 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.726373 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.726577 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.726777 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.726984 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.727186 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.727407 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.727616 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.727810 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.728011 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.728202 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.728402 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.728621 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.728787 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.728924 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.729095 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.729292 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.729553 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.729757 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.729954 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.730155 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.730356 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.730570 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.730779 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.730992 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.731185 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.731387 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.731589 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.731729 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.731852 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.732040 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.732216 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.732415 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.732624 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.732794 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.733012 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.733207 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.733442 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.733723 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.733894 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.734082 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.734278 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.734477 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.734679 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.734830 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.735023 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.735233 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.735431 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.735431 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.735824 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.736037 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.736241 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.736450 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.736649 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.736840 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.737038 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.737217 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.737511 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.737741 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.737949 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.738149 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.738348 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.738535 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.738732 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.738921 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.739112 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.739310 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.739512 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.739657 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.739799 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.739970 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.740165 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.740364 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.740577 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.740787 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.741007 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.741208 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.741431 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.741628 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.741836 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.742022 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.742215 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.742374 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.742504 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.742687 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.742888 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.743088 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.743289 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.743487 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.743691 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.743892 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.744098 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.744308 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.744503 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.744702 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.744903 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.745086 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.745260 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.745482 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.745644 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.745644 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.745972 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.745972 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.746328 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.746328 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.746712 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.746900 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.747096 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.747297 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.747500 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.747634 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.747757 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.747915 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.748119 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.748315 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.748526 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.748526 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.748921 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.749099 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.749285 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.749523 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.749750 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.749957 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.750144 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.750334 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.750567 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.750764 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.750985 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.751162 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.751295 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.751405 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.751579 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.751766 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.751965 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.752157 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.752367 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.752571 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.752763 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.752984 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.753180 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.753415 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.753616 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.753831 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.754044 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.754355 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.754567 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.754774 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.754986 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.755184 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.755375 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.755594 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.755795 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.755981 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.756183 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.756375 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.756592 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.756810 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.757011 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.757265 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.757646 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.757832 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.758051 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.758252 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.758473 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.758642 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.758770 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.758924 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.759128 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.759326 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.759529 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.759529 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.759923 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.760123 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.760336 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.760541 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.760742 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.760934 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.761124 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.761309 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.761544 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.761734 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.761923 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.762118 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.762305 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.762520 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.762724 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.762884 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.763010 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.763203 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.763408 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.763607 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.763799 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.763973 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.764150 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.764331 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.764509 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.764706 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.764883 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.765073 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.765268 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.765564 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.765762 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.765961 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.766227 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.766435 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.766637 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.766835 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.767045 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.767237 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.767437 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.767628 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.767845 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.768044 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.768188 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.768322 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.768507 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.768701 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.768911 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.769120 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.769357 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.769581 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.769781 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.769983 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.770206 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.770408 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.770611 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.770800 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.770987 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.771171 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.771353 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.771560 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.771701 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.771832 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.772036 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.772234 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.772430 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.772627 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.773070 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.773207 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.773334 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.773503 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.773626 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.773763 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.773888 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.774020 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.774144 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.774266 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.774389 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.774521 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.774672 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.774808 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.774933 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.775057 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.775178 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.775293 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.775409 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.775534 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.775642 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.775749 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.775749 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.775953 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.775953 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.776168 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.776293 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.776416 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.776528 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.776649 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.776779 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.776902 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.777024 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.777146 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.777268 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.777406 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.777552 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.777686 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.777809 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.777932 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.778053 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.778174 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.778290 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.778414 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.778549 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.778549 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.778790 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.778932 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.779057 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.779180 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.779302 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.779424 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.779547 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.779682 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.779805 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.779935 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.780059 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.780188 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.780319 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.780450 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.780450 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.780692 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.780799 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.780920 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.781044 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.781175 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.781307 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.781472 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.781598 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.781756 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.781896 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.782020 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.782127 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.782232 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.782339 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.782454 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.782570 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.782679 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.782798 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.782923 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.783046 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.783170 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.783309 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.783433 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.783433 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.783671 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.783787 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.783893 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.784038 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.784162 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.784285 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.784407 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.784530 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.784660 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.784785 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.784914 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.785029 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.785136 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.785241 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.785354 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.785497 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.785606 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.785711 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.785822 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.785929 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.786047 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.786154 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.786259 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.786365 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.786470 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.786582 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.786697 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.786813 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.786928 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.787035 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.787139 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.787254 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.787368 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.787482 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.787589 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.787702 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.787825 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.787958 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.788081 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.788204 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.788326 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.788449 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.788596 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.788736 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.788862 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.788985 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.789108 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.789230 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.789363 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.789561 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.789685 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.789809 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.789931 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.790067 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.790200 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.790323 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.790446 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.790568 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.790689 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.790826 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.790963 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.791088 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.791229 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.791384 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.791506 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.791628 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.791759 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.791889 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.792019 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.792143 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.792266 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.792444 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.792598 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.792727 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.792857 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.792981 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.792981 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.793298 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.793503 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.793503 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.793856 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.794058 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.794227 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.794365 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.794365 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.794365 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.794707 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.794829 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.794829 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.795070 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.795194 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.795325 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.795449 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.795449 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.795689 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.795813 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.795934 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.796068 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.796068 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.796301 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.796433 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.796559 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.796682 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.796682 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.796925 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.797056 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.797227 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.797370 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.797370 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.797665 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.797780 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.797780 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.797991 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.797991 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.798229 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.798361 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.798518 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.798801 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.798987 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.799182 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.799182 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.799557 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.799751 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.799974 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.800170 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.800360 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.800556 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.800756 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.800954 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.801173 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.801504 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.801758 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.801954 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.802154 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.802310 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.802310 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.802560 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.802560 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.802795 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.802927 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.803045 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.803152 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.803267 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.803391 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.803514 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.803645 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.803770 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.803899 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.804022 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.804145 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.804266 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.804398 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.804522 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.804643 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.804769 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.804890 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.805021 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.805145 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.805252 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.805431 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.805571 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.805706 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.805913 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.806041 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.806165 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.806296 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.806421 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.806551 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.806551 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.806801 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.806924 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.807047 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.807170 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.807301 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.807443 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.807576 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.807576 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.807782 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.807895 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.808025 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.808142 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.808265 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.808388 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.808388 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.808619 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.808751 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.808751 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.808999 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.809121 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.809244 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.809367 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.809593 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.809719 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.809719 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.809961 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.810085 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.810085 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.810337 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.810462 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.810598 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.810722 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.810845 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.810979 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.811112 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.811236 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.811358 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.811465 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.811587 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.811718 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.811841 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.811963 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.811963 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.812204 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.812331 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.812493 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.812618 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.812740 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.812863 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.813015 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.813153 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.813153 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.813385 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.813553 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.813553 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.813784 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.813924 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.814049 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.814180 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.814306 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.814428 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.814428 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.814673 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.814797 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.814797 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.815047 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.815171 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.815302 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.815435 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.815435 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.815663 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.815786 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.815786 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.816023 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.816156 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.816156 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.816389 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.816518 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.816642 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.816773 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.816896 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.817018 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.817148 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.817272 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.817413 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.817556 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.817688 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.817821 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.817943 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.818055 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.818167 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.818281 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.818406 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.818529 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.818651 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.818782 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.818914 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.819045 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.819170 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.819293 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.819417 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.819546 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.819678 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.819802 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.819925 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.820047 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.820170 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.820292 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.820429 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.820561 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.820684 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.820814 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.820938 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.821059 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.821191 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.821191 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.821454 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.821582 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.821712 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.821845 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.821969 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.822091 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.822220 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.822347 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.822477 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.822610 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.822734 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.822865 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.822988 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.823110 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.823232 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.823364 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.823488 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.823611 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.823733 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.823854 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.823983 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.824115 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.824239 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.824361 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.824491 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.824605 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.824746 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.824870 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.824992 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.825114 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.825221 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.825342 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.825561 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.825695 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.825818 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.825925 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.826055 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.826185 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.826316 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.826440 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.826569 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.826693 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.826816 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.826939 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.827069 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.827193 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.827315 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.827315 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.827561 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.827692 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.827823 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.827954 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.828061 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.828166 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.828273 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.828393 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.828501 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.828680 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.828796 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.828922 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.829033 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.829239 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.829366 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.829502 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.829638 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.829763 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.829904 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.830019 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.830144 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.830266 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.830373 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.830493 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.830624 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.830748 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.830857 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.830857 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.831070 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.831191 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.831315 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.831439 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.831552 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.831668 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.831787 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.831922 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.832031 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.832159 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.832284 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.832412 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.832546 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.832679 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.832804 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.832932 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.833057 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.833180 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.833302 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.833514 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.833514 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.833725 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.833858 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.833983 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.834116 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.834241 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.834363 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.834485 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.834608 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.834738 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.834870 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.834870 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.835103 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.835233 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.835364 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.835487 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.835618 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.835742 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.835867 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.835989 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.836096 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.836215 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.836323 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.836430 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.836535 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.836640 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.836745 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.836859 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.836984 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.836984 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.837225 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.837349 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.837489 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.837629 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.837753 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.837876 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.837999 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.838122 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.838236 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.838358 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.838466 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.838571 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.838676 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.838781 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.838899 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.839005 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.839127 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.839250 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.839250 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.839491 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.839621 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.839746 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.839869 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.839991 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.840113 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.840236 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.840367 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.840492 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.840614 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.840736 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.840858 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.840992 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.841116 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.841295 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.841510 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.841637 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.841768 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.841906 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.842031 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.842187 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.842314 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.842483 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.842604 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.842781 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.842910 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.843076 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.843225 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.843358 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.843530 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.843671 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.843932 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.844070 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.844286 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.844425 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.844575 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.844725 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.844849 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.845057 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.845185 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.845360 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.845526 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.845685 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.845813 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.846071 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.846212 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.846337 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.846471 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.846595 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.846703 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.846841 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.846971 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.847138 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.847274 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.847436 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.847563 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.847810 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.847945 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.848074 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.848206 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.848381 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.848510 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.848697 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.848827 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.849084 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.849222 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.849355 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.849500 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.849637 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.849760 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.849933 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.850067 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.850245 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.850370 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.850547 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.850682 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.850845 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.850981 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.851154 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.851280 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.851459 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.851593 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.851763 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.851890 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.852066 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.852193 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.852369 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.852505 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.852671 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.852797 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.852972 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.853098 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.853291 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.853512 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.853641 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.853764 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.853925 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.854061 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.854268 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.854394 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.854525 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.854650 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.854835 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.854971 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.855167 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.855361 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.855556 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 27 02:12:03.855786 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.856172 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.856478 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.856789 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.857098 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.857424 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.857732 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.858221 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.858374 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.859994 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.859994 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.859994 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.859994 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.859994 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.860924 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.860924 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.860924 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.861270 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.861512 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.865516 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.865516 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.865516 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.865516 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.865516 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:12:03.865516 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 27 02:12:04.012478 dv-cinder-846303-3-smb devstack@n-api.service[105760]: INFO dbcounter [None req-4db0d6d0-acf1-40c9-a0a3-496de5e80d54 None None] Registered counter for database nova_api Aug 27 02:12:04.019093 dv-cinder-846303-3-smb devstack@n-api.service[105759]: INFO dbcounter [None req-890229a1-f9c5-4875-9179-1d6c1d6f53e0 None None] Registered counter for database nova_api Aug 27 02:12:04.034542 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG oslo_db.sqlalchemy.engines [None req-4db0d6d0-acf1-40c9-a0a3-496de5e80d54 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105760) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 02:12:04.041829 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG dbcounter [-] [105760] Writer thread running {{(pid=105760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 02:12:04.044440 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG oslo_db.sqlalchemy.engines [None req-890229a1-f9c5-4875-9179-1d6c1d6f53e0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105759) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 02:12:04.051472 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG dbcounter [-] [105759] Writer thread running {{(pid=105759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 02:12:04.102994 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.context [None req-4db0d6d0-acf1-40c9-a0a3-496de5e80d54 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fd1fc341-d010-4ff9-88d0-44b72da91d5f(cell1) {{(pid=105760) load_cells /opt/stack/nova/nova/context.py:464}} Aug 27 02:12:04.107237 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG oslo_concurrency.lockutils [None req-4db0d6d0-acf1-40c9-a0a3-496de5e80d54 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:12:04.107727 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG oslo_concurrency.lockutils [None req-4db0d6d0-acf1-40c9-a0a3-496de5e80d54 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:12:04.109337 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG oslo_concurrency.lockutils [None req-4db0d6d0-acf1-40c9-a0a3-496de5e80d54 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:12:04.111101 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG oslo_concurrency.lockutils [None req-4db0d6d0-acf1-40c9-a0a3-496de5e80d54 None None] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:12:04.111101 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG oslo_concurrency.lockutils [None req-4db0d6d0-acf1-40c9-a0a3-496de5e80d54 None None] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:12:04.112639 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG oslo_concurrency.lockutils [None req-4db0d6d0-acf1-40c9-a0a3-496de5e80d54 None None] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:12:04.114943 dv-cinder-846303-3-smb devstack@n-api.service[105760]: INFO dbcounter [None req-4db0d6d0-acf1-40c9-a0a3-496de5e80d54 None None] Registered counter for database nova_cell0 Aug 27 02:12:04.115220 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.context [None req-890229a1-f9c5-4875-9179-1d6c1d6f53e0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fd1fc341-d010-4ff9-88d0-44b72da91d5f(cell1) {{(pid=105759) load_cells /opt/stack/nova/nova/context.py:464}} Aug 27 02:12:04.119377 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG oslo_concurrency.lockutils [None req-890229a1-f9c5-4875-9179-1d6c1d6f53e0 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:12:04.119543 dv-cinder-846303-3-smb devstack@n-api.service[105760]: INFO dbcounter [None req-4db0d6d0-acf1-40c9-a0a3-496de5e80d54 None None] Registered counter for database nova_cell1 Aug 27 02:12:04.119863 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG oslo_concurrency.lockutils [None req-890229a1-f9c5-4875-9179-1d6c1d6f53e0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:12:04.122043 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG oslo_concurrency.lockutils [None req-890229a1-f9c5-4875-9179-1d6c1d6f53e0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:12:04.122689 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG oslo_concurrency.lockutils [None req-890229a1-f9c5-4875-9179-1d6c1d6f53e0 None None] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:12:04.122946 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG oslo_concurrency.lockutils [None req-890229a1-f9c5-4875-9179-1d6c1d6f53e0 None None] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:12:04.124949 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG oslo_concurrency.lockutils [None req-890229a1-f9c5-4875-9179-1d6c1d6f53e0 None None] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:12:04.127164 dv-cinder-846303-3-smb devstack@n-api.service[105759]: INFO dbcounter [None req-890229a1-f9c5-4875-9179-1d6c1d6f53e0 None None] Registered counter for database nova_cell0 Aug 27 02:12:04.127535 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG oslo_db.sqlalchemy.engines [None req-4db0d6d0-acf1-40c9-a0a3-496de5e80d54 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105760) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 02:12:04.131612 dv-cinder-846303-3-smb devstack@n-api.service[105759]: INFO dbcounter [None req-890229a1-f9c5-4875-9179-1d6c1d6f53e0 None None] Registered counter for database nova_cell1 Aug 27 02:12:04.131788 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG oslo_db.sqlalchemy.engines [None req-4db0d6d0-acf1-40c9-a0a3-496de5e80d54 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105760) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 02:12:04.135194 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG dbcounter [-] [105760] Writer thread running {{(pid=105760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 02:12:04.139223 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG oslo_db.sqlalchemy.engines [None req-890229a1-f9c5-4875-9179-1d6c1d6f53e0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105759) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 02:12:04.144233 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG oslo_db.sqlalchemy.engines [None req-890229a1-f9c5-4875-9179-1d6c1d6f53e0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105759) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 02:12:04.146054 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG dbcounter [-] [105759] Writer thread running {{(pid=105759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 02:12:04.286985 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG dbcounter [-] [105760] Writer thread running {{(pid=105760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 02:12:04.289223 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG dbcounter [-] [105759] Writer thread running {{(pid=105759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 02:12:04.298161 dv-cinder-846303-3-smb devstack@n-api.service[105760]: INFO dbcounter [None req-4db0d6d0-acf1-40c9-a0a3-496de5e80d54 None None] Registered counter for database nova_cell0 Aug 27 02:12:04.298450 dv-cinder-846303-3-smb devstack@n-api.service[105759]: INFO dbcounter [None req-890229a1-f9c5-4875-9179-1d6c1d6f53e0 None None] Registered counter for database nova_cell0 Aug 27 02:12:04.305789 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG oslo_db.sqlalchemy.engines [None req-4db0d6d0-acf1-40c9-a0a3-496de5e80d54 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105760) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 02:12:04.311132 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG dbcounter [-] [105760] Writer thread running {{(pid=105760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 02:12:04.312468 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG oslo_db.sqlalchemy.engines [None req-890229a1-f9c5-4875-9179-1d6c1d6f53e0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105759) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 02:12:04.320013 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG dbcounter [-] [105759] Writer thread running {{(pid=105759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 02:12:04.661171 dv-cinder-846303-3-smb devstack@n-api.service[105760]: WARNING keystonemiddleware.auth_token [None req-4db0d6d0-acf1-40c9-a0a3-496de5e80d54 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 27 02:12:04.669172 dv-cinder-846303-3-smb devstack@n-api.service[105760]: WARNING keystonemiddleware.auth_token [None req-4db0d6d0-acf1-40c9-a0a3-496de5e80d54 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 27 02:12:04.788117 dv-cinder-846303-3-smb devstack@n-api.service[105759]: WARNING keystonemiddleware.auth_token [None req-890229a1-f9c5-4875-9179-1d6c1d6f53e0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 27 02:12:04.799722 dv-cinder-846303-3-smb devstack@n-api.service[105759]: WARNING keystonemiddleware.auth_token [None req-890229a1-f9c5-4875-9179-1d6c1d6f53e0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 27 02:12:05.027099 dv-cinder-846303-3-smb devstack@n-api.service[105760]: WARNING keystonemiddleware.auth_token [None req-4db0d6d0-acf1-40c9-a0a3-496de5e80d54 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 27 02:12:05.033778 dv-cinder-846303-3-smb devstack@n-api.service[105760]: WARNING keystonemiddleware.auth_token [None req-4db0d6d0-acf1-40c9-a0a3-496de5e80d54 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 27 02:12:05.039435 dv-cinder-846303-3-smb devstack@n-api.service[105760]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a7bda759c0 pid: 105760 (default app) Aug 27 02:12:05.041616 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi [None req-4db0d6d0-acf1-40c9-a0a3-496de5e80d54 None None] Calling method '>' {{(pid=105760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:12:05.042873 dv-cinder-846303-3-smb devstack@n-api.service[105760]: INFO nova.api.openstack.requestlog [None req-4db0d6d0-acf1-40c9-a0a3-496de5e80d54 None None] 10.222.0.61 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001816 Aug 27 02:12:05.043300 dv-cinder-846303-3-smb devstack@n-api.service[105760]: [pid: 105760|app: 0|req: 1/1] 10.222.0.61 () {50 vars in 788 bytes} [Sat Aug 27 02:12:05 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:12:05.255017 dv-cinder-846303-3-smb devstack@n-api.service[105759]: WARNING keystonemiddleware.auth_token [None req-890229a1-f9c5-4875-9179-1d6c1d6f53e0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 27 02:12:05.263280 dv-cinder-846303-3-smb devstack@n-api.service[105759]: WARNING keystonemiddleware.auth_token [None req-890229a1-f9c5-4875-9179-1d6c1d6f53e0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 27 02:12:05.269895 dv-cinder-846303-3-smb devstack@n-api.service[105759]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a7bda759c0 pid: 105759 (default app) Aug 27 02:13:27.141409 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi [None req-4db0d6d0-acf1-40c9-a0a3-496de5e80d54 None None] Calling method '>' {{(pid=105760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:13:27.142510 dv-cinder-846303-3-smb devstack@n-api.service[105760]: INFO nova.api.openstack.requestlog [None req-4db0d6d0-acf1-40c9-a0a3-496de5e80d54 None None] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001534 Aug 27 02:13:27.143145 dv-cinder-846303-3-smb devstack@n-api.service[105760]: [pid: 105760|app: 0|req: 2/2] 10.222.0.61 () {54 vars in 931 bytes} [Sat Aug 27 02:13:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:13:27.159926 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG dbcounter [-] [105759] Writing DB stats nova_api:SELECT=3 {{(pid=105759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:13:27.160853 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG dbcounter [-] [105759] Writing DB stats nova_cell0:SELECT=3 {{(pid=105759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:13:27.161852 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG dbcounter [-] [105759] Writing DB stats nova_cell1:SELECT=3 {{(pid=105759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:13:27.162565 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG dbcounter [-] [105759] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:13:28.071149 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi [None req-99d7be0d-97bc-4570-a5ec-a852d1ded365 admin admin] Calling method '>' {{(pid=105759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:13:28.103033 dv-cinder-846303-3-smb devstack@n-api.service[105759]: INFO nova.api.openstack.requestlog [None req-99d7be0d-97bc-4570-a5ec-a852d1ded365 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.952322 Aug 27 02:13:28.105434 dv-cinder-846303-3-smb devstack@n-api.service[105759]: [pid: 105759|app: 0|req: 1/3] 10.222.0.61 () {60 vars in 1292 bytes} [Sat Aug 27 02:13:27 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:13:30.519086 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi [None req-4db0d6d0-acf1-40c9-a0a3-496de5e80d54 None None] Calling method '>' {{(pid=105760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:13:30.520107 dv-cinder-846303-3-smb devstack@n-api.service[105760]: INFO nova.api.openstack.requestlog [None req-4db0d6d0-acf1-40c9-a0a3-496de5e80d54 None None] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001539 Aug 27 02:13:30.521436 dv-cinder-846303-3-smb devstack@n-api.service[105760]: [pid: 105760|app: 0|req: 3/4] 10.222.0.61 () {54 vars in 931 bytes} [Sat Aug 27 02:13:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:13:30.972513 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi [None req-1b20196a-ed49-4416-826a-78785175fcb8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "id": "c1", "disk": 1, "rxtx_factor": 1.0, "vcpus": 1, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=105759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:13:31.022482 dv-cinder-846303-3-smb devstack@n-api.service[105759]: INFO nova.api.openstack.requestlog [None req-1b20196a-ed49-4416-826a-78785175fcb8 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.490790 Aug 27 02:13:31.023402 dv-cinder-846303-3-smb devstack@n-api.service[105759]: [pid: 105759|app: 0|req: 2/5] 10.222.0.61 () {64 vars in 1283 bytes} [Sat Aug 27 02:13:30 2022] POST /compute/v2.1/flavors => generated 407 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:13:31.037478 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG dbcounter [-] [105760] Writing DB stats nova_api:SELECT=3 {{(pid=105760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:13:31.038740 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG dbcounter [-] [105760] Writing DB stats nova_cell0:SELECT=3 {{(pid=105760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:13:31.039533 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG dbcounter [-] [105760] Writing DB stats nova_cell1:SELECT=3 {{(pid=105760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:13:31.040334 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG dbcounter [-] [105760] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:13:31.252580 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi [None req-6810155a-cb1e-4088-9b98-223bba14fa4a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:13:31.318066 dv-cinder-846303-3-smb devstack@n-api.service[105760]: INFO nova.api.openstack.requestlog [None req-6810155a-cb1e-4088-9b98-223bba14fa4a admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.286222 Aug 27 02:13:31.318659 dv-cinder-846303-3-smb devstack@n-api.service[105760]: [pid: 105760|app: 0|req: 4/6] 10.222.0.61 () {64 vars in 1336 bytes} [Sat Aug 27 02:13:31 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:13:33.735727 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi [None req-1b20196a-ed49-4416-826a-78785175fcb8 admin admin] Calling method '>' {{(pid=105759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:13:33.736755 dv-cinder-846303-3-smb devstack@n-api.service[105759]: INFO nova.api.openstack.requestlog [None req-1b20196a-ed49-4416-826a-78785175fcb8 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Aug 27 02:13:33.737153 dv-cinder-846303-3-smb devstack@n-api.service[105759]: [pid: 105759|app: 0|req: 3/7] 10.222.0.61 () {54 vars in 931 bytes} [Sat Aug 27 02:13:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:13:34.459311 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi [None req-152cf2bf-48ab-4e8f-ba34-e2681a8766fd admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 1, "name": "ds512M", "id": "d1"}} {{(pid=105760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:13:34.498050 dv-cinder-846303-3-smb devstack@n-api.service[105760]: INFO nova.api.openstack.requestlog [None req-152cf2bf-48ab-4e8f-ba34-e2681a8766fd admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.754301 Aug 27 02:13:34.498903 dv-cinder-846303-3-smb devstack@n-api.service[105760]: [pid: 105760|app: 0|req: 5/8] 10.222.0.61 () {64 vars in 1283 bytes} [Sat Aug 27 02:13:33 2022] POST /compute/v2.1/flavors => generated 404 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:13:34.511896 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi [None req-b0dfb1b3-8f16-4b04-8781-3b65bc98dc06 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:13:34.550402 dv-cinder-846303-3-smb devstack@n-api.service[105759]: INFO nova.api.openstack.requestlog [None req-b0dfb1b3-8f16-4b04-8781-3b65bc98dc06 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042256 Aug 27 02:13:34.551091 dv-cinder-846303-3-smb devstack@n-api.service[105759]: [pid: 105759|app: 0|req: 4/9] 10.222.0.61 () {64 vars in 1336 bytes} [Sat Aug 27 02:13:34 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:13:36.892063 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi [None req-152cf2bf-48ab-4e8f-ba34-e2681a8766fd admin admin] Calling method '>' {{(pid=105760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:13:36.893091 dv-cinder-846303-3-smb devstack@n-api.service[105760]: INFO nova.api.openstack.requestlog [None req-152cf2bf-48ab-4e8f-ba34-e2681a8766fd admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Aug 27 02:13:36.893693 dv-cinder-846303-3-smb devstack@n-api.service[105760]: [pid: 105760|app: 0|req: 6/10] 10.222.0.61 () {54 vars in 931 bytes} [Sat Aug 27 02:13:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:13:37.330705 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi [None req-721ef679-c6c9-48ff-a91e-34f6ac621ae2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 10, "rxtx_factor": 1.0, "ram": 1024, "vcpus": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "name": "ds1G"}} {{(pid=105759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:13:37.350235 dv-cinder-846303-3-smb devstack@n-api.service[105759]: INFO nova.api.openstack.requestlog [None req-721ef679-c6c9-48ff-a91e-34f6ac621ae2 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.449997 Aug 27 02:13:37.350795 dv-cinder-846303-3-smb devstack@n-api.service[105759]: [pid: 105759|app: 0|req: 5/11] 10.222.0.61 () {64 vars in 1283 bytes} [Sat Aug 27 02:13:36 2022] POST /compute/v2.1/flavors => generated 404 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:13:37.364261 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi [None req-2c62687a-785c-46ee-8d3d-16f3bfedf255 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:13:37.390823 dv-cinder-846303-3-smb devstack@n-api.service[105760]: INFO nova.api.openstack.requestlog [None req-2c62687a-785c-46ee-8d3d-16f3bfedf255 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030857 Aug 27 02:13:37.391322 dv-cinder-846303-3-smb devstack@n-api.service[105760]: [pid: 105760|app: 0|req: 7/12] 10.222.0.61 () {64 vars in 1336 bytes} [Sat Aug 27 02:13:37 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:13:39.724025 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi [None req-721ef679-c6c9-48ff-a91e-34f6ac621ae2 admin admin] Calling method '>' {{(pid=105759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:13:39.729671 dv-cinder-846303-3-smb devstack@n-api.service[105759]: INFO nova.api.openstack.requestlog [None req-721ef679-c6c9-48ff-a91e-34f6ac621ae2 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001754 Aug 27 02:13:39.730143 dv-cinder-846303-3-smb devstack@n-api.service[105759]: [pid: 105759|app: 0|req: 6/13] 10.222.0.61 () {54 vars in 931 bytes} [Sat Aug 27 02:13:39 2022] GET /compute/v2.1 => generated 388 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:13:40.216279 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi [None req-bc98fb3f-ab99-49ee-b354-b69e38505d56 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 2, "os-flavor-access:is_public": true, "disk": 10, "name": "ds2G", "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "d3"}} {{(pid=105760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:13:40.236052 dv-cinder-846303-3-smb devstack@n-api.service[105760]: INFO nova.api.openstack.requestlog [None req-bc98fb3f-ab99-49ee-b354-b69e38505d56 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.498939 Aug 27 02:13:40.236794 dv-cinder-846303-3-smb devstack@n-api.service[105760]: [pid: 105760|app: 0|req: 8/14] 10.222.0.61 () {64 vars in 1283 bytes} [Sat Aug 27 02:13:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:13:40.248750 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi [None req-02d60b50-5c9b-4ac0-a32d-eb44ec88abc1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:13:40.274324 dv-cinder-846303-3-smb devstack@n-api.service[105759]: INFO nova.api.openstack.requestlog [None req-02d60b50-5c9b-4ac0-a32d-eb44ec88abc1 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029239 Aug 27 02:13:40.274974 dv-cinder-846303-3-smb devstack@n-api.service[105759]: [pid: 105759|app: 0|req: 7/15] 10.222.0.61 () {64 vars in 1336 bytes} [Sat Aug 27 02:13:40 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:13:42.681350 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi [None req-bc98fb3f-ab99-49ee-b354-b69e38505d56 admin admin] Calling method '>' {{(pid=105760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:13:42.682427 dv-cinder-846303-3-smb devstack@n-api.service[105760]: INFO nova.api.openstack.requestlog [None req-bc98fb3f-ab99-49ee-b354-b69e38505d56 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001551 Aug 27 02:13:42.683073 dv-cinder-846303-3-smb devstack@n-api.service[105760]: [pid: 105760|app: 0|req: 9/16] 10.222.0.61 () {54 vars in 931 bytes} [Sat Aug 27 02:13:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:13:43.139370 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi [None req-f9f0719b-7b55-40a3-9db2-780f9165397f admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "disk": 20, "os-flavor-access:is_public": true, "id": "d4", "swap": 0, "rxtx_factor": 1.0}} {{(pid=105759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:13:43.161524 dv-cinder-846303-3-smb devstack@n-api.service[105759]: INFO nova.api.openstack.requestlog [None req-f9f0719b-7b55-40a3-9db2-780f9165397f admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.471094 Aug 27 02:13:43.165537 dv-cinder-846303-3-smb devstack@n-api.service[105759]: [pid: 105759|app: 0|req: 8/17] 10.222.0.61 () {64 vars in 1283 bytes} [Sat Aug 27 02:13:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 02:13:43.174688 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi [None req-874566cf-f818-43fc-a34e-d6099047a404 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:13:43.206354 dv-cinder-846303-3-smb devstack@n-api.service[105760]: INFO nova.api.openstack.requestlog [None req-874566cf-f818-43fc-a34e-d6099047a404 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035401 Aug 27 02:13:43.207002 dv-cinder-846303-3-smb devstack@n-api.service[105760]: [pid: 105760|app: 0|req: 10/18] 10.222.0.61 () {64 vars in 1336 bytes} [Sat Aug 27 02:13:43 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:13:45.717599 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi [None req-f9f0719b-7b55-40a3-9db2-780f9165397f admin admin] Calling method '>' {{(pid=105759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:13:45.718916 dv-cinder-846303-3-smb devstack@n-api.service[105759]: INFO nova.api.openstack.requestlog [None req-f9f0719b-7b55-40a3-9db2-780f9165397f admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001929 Aug 27 02:13:45.719448 dv-cinder-846303-3-smb devstack@n-api.service[105759]: [pid: 105759|app: 0|req: 9/19] 10.222.0.61 () {54 vars in 931 bytes} [Sat Aug 27 02:13:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:13:46.185614 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi [None req-ec124b4b-9da6-48b9-a6f3-8977d4f0ce45 admin admin] Calling method '>' {{(pid=105760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:13:46.216728 dv-cinder-846303-3-smb devstack@n-api.service[105760]: INFO nova.api.openstack.requestlog [None req-ec124b4b-9da6-48b9-a6f3-8977d4f0ce45 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.489380 Aug 27 02:13:46.217444 dv-cinder-846303-3-smb devstack@n-api.service[105760]: [pid: 105760|app: 0|req: 11/20] 10.222.0.61 () {60 vars in 1292 bytes} [Sat Aug 27 02:13:45 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:13:48.795577 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi [None req-f9f0719b-7b55-40a3-9db2-780f9165397f admin admin] Calling method '>' {{(pid=105759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:13:48.796591 dv-cinder-846303-3-smb devstack@n-api.service[105759]: INFO nova.api.openstack.requestlog [None req-f9f0719b-7b55-40a3-9db2-780f9165397f admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Aug 27 02:13:48.797026 dv-cinder-846303-3-smb devstack@n-api.service[105759]: [pid: 105759|app: 0|req: 10/21] 10.222.0.61 () {54 vars in 931 bytes} [Sat Aug 27 02:13:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:13:49.299801 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi [None req-6078696e-b984-4c50-9a78-7ab91c4e760c admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "disk": 1, "os-flavor-access:is_public": true, "vcpus": 1, "swap": 0, "name": "m1.tiny"}} {{(pid=105760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:13:49.324594 dv-cinder-846303-3-smb devstack@n-api.service[105760]: INFO nova.api.openstack.requestlog [None req-6078696e-b984-4c50-9a78-7ab91c4e760c admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.520166 Aug 27 02:13:49.325551 dv-cinder-846303-3-smb devstack@n-api.service[105760]: [pid: 105760|app: 0|req: 12/22] 10.222.0.61 () {64 vars in 1283 bytes} [Sat Aug 27 02:13:48 2022] POST /compute/v2.1/flavors => generated 402 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:13:49.337705 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi [None req-86128fc7-09e7-4881-a505-6b862bb958cd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:13:49.366103 dv-cinder-846303-3-smb devstack@n-api.service[105759]: INFO nova.api.openstack.requestlog [None req-86128fc7-09e7-4881-a505-6b862bb958cd admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031960 Aug 27 02:13:49.367251 dv-cinder-846303-3-smb devstack@n-api.service[105759]: [pid: 105759|app: 0|req: 11/23] 10.222.0.61 () {64 vars in 1333 bytes} [Sat Aug 27 02:13:49 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:13:51.780433 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi [None req-6078696e-b984-4c50-9a78-7ab91c4e760c admin admin] Calling method '>' {{(pid=105760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:13:51.781307 dv-cinder-846303-3-smb devstack@n-api.service[105760]: INFO nova.api.openstack.requestlog [None req-6078696e-b984-4c50-9a78-7ab91c4e760c admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Aug 27 02:13:51.781820 dv-cinder-846303-3-smb devstack@n-api.service[105760]: [pid: 105760|app: 0|req: 13/24] 10.222.0.61 () {54 vars in 931 bytes} [Sat Aug 27 02:13:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:13:52.257105 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi [None req-cf28c6ad-7fa1-4f01-a838-c6dc689dba54 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "ram": 2048, "swap": 0, "disk": 20, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "2", "name": "m1.small"}} {{(pid=105759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:13:52.279960 dv-cinder-846303-3-smb devstack@n-api.service[105759]: INFO nova.api.openstack.requestlog [None req-cf28c6ad-7fa1-4f01-a838-c6dc689dba54 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.491435 Aug 27 02:13:52.280512 dv-cinder-846303-3-smb devstack@n-api.service[105759]: [pid: 105759|app: 0|req: 12/25] 10.222.0.61 () {64 vars in 1283 bytes} [Sat Aug 27 02:13:51 2022] POST /compute/v2.1/flavors => generated 405 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 02:13:52.293760 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi [None req-d7c75936-dff0-435d-9662-0efe879a71e6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:13:52.320537 dv-cinder-846303-3-smb devstack@n-api.service[105760]: INFO nova.api.openstack.requestlog [None req-d7c75936-dff0-435d-9662-0efe879a71e6 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030299 Aug 27 02:13:52.321268 dv-cinder-846303-3-smb devstack@n-api.service[105760]: [pid: 105760|app: 0|req: 14/26] 10.222.0.61 () {64 vars in 1333 bytes} [Sat Aug 27 02:13:52 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:13:54.698505 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi [None req-cf28c6ad-7fa1-4f01-a838-c6dc689dba54 admin admin] Calling method '>' {{(pid=105759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:13:54.699524 dv-cinder-846303-3-smb devstack@n-api.service[105759]: INFO nova.api.openstack.requestlog [None req-cf28c6ad-7fa1-4f01-a838-c6dc689dba54 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Aug 27 02:13:54.699921 dv-cinder-846303-3-smb devstack@n-api.service[105759]: [pid: 105759|app: 0|req: 13/27] 10.222.0.61 () {54 vars in 931 bytes} [Sat Aug 27 02:13:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:13:55.145292 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi [None req-e75d96db-1e9f-4fb1-b6a4-ea8322122e2a admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "disk": 40, "id": "3", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 2, "name": "m1.medium", "swap": 0}} {{(pid=105760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:13:55.166675 dv-cinder-846303-3-smb devstack@n-api.service[105760]: INFO nova.api.openstack.requestlog [None req-e75d96db-1e9f-4fb1-b6a4-ea8322122e2a admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.460202 Aug 27 02:13:55.169434 dv-cinder-846303-3-smb devstack@n-api.service[105760]: [pid: 105760|app: 0|req: 15/28] 10.222.0.61 () {64 vars in 1283 bytes} [Sat Aug 27 02:13:54 2022] POST /compute/v2.1/flavors => generated 406 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:13:55.182649 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi [None req-18878e31-3617-42ed-ba44-a2c266191bbd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:13:55.208302 dv-cinder-846303-3-smb devstack@n-api.service[105759]: INFO nova.api.openstack.requestlog [None req-18878e31-3617-42ed-ba44-a2c266191bbd admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031621 Aug 27 02:13:55.208980 dv-cinder-846303-3-smb devstack@n-api.service[105759]: [pid: 105759|app: 0|req: 14/29] 10.222.0.61 () {64 vars in 1333 bytes} [Sat Aug 27 02:13:55 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:13:57.602701 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi [None req-e75d96db-1e9f-4fb1-b6a4-ea8322122e2a admin admin] Calling method '>' {{(pid=105760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:13:57.603722 dv-cinder-846303-3-smb devstack@n-api.service[105760]: INFO nova.api.openstack.requestlog [None req-e75d96db-1e9f-4fb1-b6a4-ea8322122e2a admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Aug 27 02:13:57.604393 dv-cinder-846303-3-smb devstack@n-api.service[105760]: [pid: 105760|app: 0|req: 16/30] 10.222.0.61 () {54 vars in 931 bytes} [Sat Aug 27 02:13:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:13:58.134345 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi [None req-443136ad-5bfd-47e3-b0ca-1e8d7516200b admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 80, "id": "4", "name": "m1.large", "ram": 8192, "vcpus": 4}} {{(pid=105759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:13:58.140049 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG dbcounter [-] [105759] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:13:58.157309 dv-cinder-846303-3-smb devstack@n-api.service[105759]: INFO nova.api.openstack.requestlog [None req-443136ad-5bfd-47e3-b0ca-1e8d7516200b admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.546383 Aug 27 02:13:58.158848 dv-cinder-846303-3-smb devstack@n-api.service[105759]: [pid: 105759|app: 0|req: 15/31] 10.222.0.61 () {64 vars in 1283 bytes} [Sat Aug 27 02:13:57 2022] POST /compute/v2.1/flavors => generated 405 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:13:58.170783 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi [None req-89160c1d-9d61-4600-b636-4a25bb839f47 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:13:58.197886 dv-cinder-846303-3-smb devstack@n-api.service[105760]: INFO nova.api.openstack.requestlog [None req-89160c1d-9d61-4600-b636-4a25bb839f47 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030742 Aug 27 02:13:58.198745 dv-cinder-846303-3-smb devstack@n-api.service[105760]: [pid: 105760|app: 0|req: 17/32] 10.222.0.61 () {64 vars in 1333 bytes} [Sat Aug 27 02:13:58 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:14:00.583843 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi [None req-443136ad-5bfd-47e3-b0ca-1e8d7516200b admin admin] Calling method '>' {{(pid=105759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:14:00.584848 dv-cinder-846303-3-smb devstack@n-api.service[105759]: INFO nova.api.openstack.requestlog [None req-443136ad-5bfd-47e3-b0ca-1e8d7516200b admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Aug 27 02:14:00.585529 dv-cinder-846303-3-smb devstack@n-api.service[105759]: [pid: 105759|app: 0|req: 16/33] 10.222.0.61 () {54 vars in 931 bytes} [Sat Aug 27 02:14:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:14:01.108948 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi [None req-3a6c1ac9-8f22-4234-8c1c-75ee7ab856c7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 16384, "disk": 160, "swap": 0, "name": "m1.xlarge", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "id": "5"}} {{(pid=105760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:14:01.128665 dv-cinder-846303-3-smb devstack@n-api.service[105760]: INFO nova.api.openstack.requestlog [None req-3a6c1ac9-8f22-4234-8c1c-75ee7ab856c7 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.536310 Aug 27 02:14:01.129450 dv-cinder-846303-3-smb devstack@n-api.service[105760]: [pid: 105760|app: 0|req: 18/34] 10.222.0.61 () {64 vars in 1283 bytes} [Sat Aug 27 02:14:00 2022] POST /compute/v2.1/flavors => generated 408 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:14:01.141611 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi [None req-4d452d6c-0905-430e-93b3-be193ee5659a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:14:01.167907 dv-cinder-846303-3-smb devstack@n-api.service[105759]: INFO nova.api.openstack.requestlog [None req-4d452d6c-0905-430e-93b3-be193ee5659a admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029970 Aug 27 02:14:01.168607 dv-cinder-846303-3-smb devstack@n-api.service[105759]: [pid: 105759|app: 0|req: 17/35] 10.222.0.61 () {64 vars in 1333 bytes} [Sat Aug 27 02:14:01 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:14:20.025585 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi [None req-3a6c1ac9-8f22-4234-8c1c-75ee7ab856c7 admin admin] Calling method '>' {{(pid=105760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:14:20.026913 dv-cinder-846303-3-smb devstack@n-api.service[105760]: INFO nova.api.openstack.requestlog [None req-3a6c1ac9-8f22-4234-8c1c-75ee7ab856c7 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002051 Aug 27 02:14:20.027515 dv-cinder-846303-3-smb devstack@n-api.service[105760]: [pid: 105760|app: 0|req: 19/36] 10.222.0.61 () {54 vars in 931 bytes} [Sat Aug 27 02:14:20 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:14:20.044113 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG dbcounter [-] [105759] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:14:20.485542 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi [None req-bc8cb41d-633c-476a-bab8-83b99a597f0d admin admin] Calling method '>' {{(pid=105759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:14:20.508516 dv-cinder-846303-3-smb devstack@n-api.service[105759]: INFO nova.api.openstack.requestlog [None req-bc8cb41d-633c-476a-bab8-83b99a597f0d admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.470798 Aug 27 02:14:20.509157 dv-cinder-846303-3-smb devstack@n-api.service[105759]: [pid: 105759|app: 0|req: 18/37] 10.222.0.61 () {60 vars in 1292 bytes} [Sat Aug 27 02:14:20 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:14:21.594467 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi [None req-3a6c1ac9-8f22-4234-8c1c-75ee7ab856c7 admin admin] Calling method '>' {{(pid=105760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:14:21.595779 dv-cinder-846303-3-smb devstack@n-api.service[105760]: INFO nova.api.openstack.requestlog [None req-3a6c1ac9-8f22-4234-8c1c-75ee7ab856c7 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002030 Aug 27 02:14:21.596373 dv-cinder-846303-3-smb devstack@n-api.service[105760]: [pid: 105760|app: 0|req: 20/38] 10.222.0.61 () {56 vars in 1074 bytes} [Sat Aug 27 02:14:21 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:14:22.153214 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi [None req-7d2221cb-1e03-4e38-a895-41468f0b417d admin admin] Calling method '>' {{(pid=105759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:14:22.158911 dv-cinder-846303-3-smb devstack@n-api.service[105759]: INFO nova.api.openstack.wsgi [None req-7d2221cb-1e03-4e38-a895-41468f0b417d admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 27 02:14:22.162157 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi [None req-7d2221cb-1e03-4e38-a895-41468f0b417d admin admin] Request method failure captured: Aug 27 02:14:22.162157 dv-cinder-846303-3-smb devstack@n-api.service[105759]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 27 02:14:22.162157 dv-cinder-846303-3-smb devstack@n-api.service[105759]: Accept: application/json Aug 27 02:14:22.162157 dv-cinder-846303-3-smb devstack@n-api.service[105759]: Accept-Encoding: gzip, deflate Aug 27 02:14:22.162157 dv-cinder-846303-3-smb devstack@n-api.service[105759]: Connection: keep-alive Aug 27 02:14:22.162157 dv-cinder-846303-3-smb devstack@n-api.service[105759]: Content-Length: 0 Aug 27 02:14:22.162157 dv-cinder-846303-3-smb devstack@n-api.service[105759]: Host: 10.222.0.61 Aug 27 02:14:22.162157 dv-cinder-846303-3-smb devstack@n-api.service[105759]: Openstack-Api-Version: compute 2.90 Aug 27 02:14:22.162157 dv-cinder-846303-3-smb devstack@n-api.service[105759]: Openstack-System-Scope: None Aug 27 02:14:22.162157 dv-cinder-846303-3-smb devstack@n-api.service[105759]: User-Agent: python-novaclient Aug 27 02:14:22.162157 dv-cinder-846303-3-smb devstack@n-api.service[105759]: X-Auth-Token: gAAAAABjCX39Fhn8pSOXQf7kqcuDpIpWWpMJu8OTDvm5wM8aYzQcKaNs0NwGue3htDdWmUHj3FYzKnzRDQtg02HgYOR1zVAECh8Ws1TLyWi3Xs21mETi9RxKoStW6pkOS8kh8jRmAxuZ-O7SarYbD8aLqWAqKSq8QA422RFZnfTNDhcUT5BzrAY Aug 27 02:14:22.162157 dv-cinder-846303-3-smb devstack@n-api.service[105759]: X-Domain-Id: None Aug 27 02:14:22.162157 dv-cinder-846303-3-smb devstack@n-api.service[105759]: X-Domain-Name: None Aug 27 02:14:22.162157 dv-cinder-846303-3-smb devstack@n-api.service[105759]: X-Identity-Status: Confirmed Aug 27 02:14:22.162157 dv-cinder-846303-3-smb devstack@n-api.service[105759]: X-Is-Admin-Project: True Aug 27 02:14:22.162157 dv-cinder-846303-3-smb devstack@n-api.service[105759]: X-Openstack-Nova-Api-Version: 2.90 Aug 27 02:14:22.162157 dv-cinder-846303-3-smb devstack@n-api.service[105759]: X-Project-Domain-Id: default Aug 27 02:14:22.162157 dv-cinder-846303-3-smb devstack@n-api.service[105759]: X-Project-Domain-Name: Default Aug 27 02:14:22.162157 dv-cinder-846303-3-smb devstack@n-api.service[105759]: X-Project-Id: 6316912820d4459d94f37567f9470b42 Aug 27 02:14:22.162157 dv-cinder-846303-3-smb devstack@n-api.service[105759]: X-Project-Name: admin Aug 27 02:14:22.162157 dv-cinder-846303-3-smb devstack@n-api.service[105759]: X-Role: member,admin,reader Aug 27 02:14:22.162157 dv-cinder-846303-3-smb devstack@n-api.service[105759]: X-Roles: member,admin,reader Aug 27 02:14:22.164699 dv-cinder-846303-3-smb devstack@n-api.service[105759]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/6316912820d4459d94f37567f9470b42"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_6316912820d4459d94f37567f9470b42", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6316912820d4459d94f37567f9470b42"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6316912820d4459d94f37567f9470b42"}]}] Aug 27 02:14:22.164699 dv-cinder-846303-3-smb devstack@n-api.service[105759]: X-Tenant: admin Aug 27 02:14:22.164699 dv-cinder-846303-3-smb devstack@n-api.service[105759]: X-Tenant-Id: 6316912820d4459d94f37567f9470b42 Aug 27 02:14:22.164699 dv-cinder-846303-3-smb devstack@n-api.service[105759]: X-Tenant-Name: admin Aug 27 02:14:22.164699 dv-cinder-846303-3-smb devstack@n-api.service[105759]: X-User: admin Aug 27 02:14:22.164699 dv-cinder-846303-3-smb devstack@n-api.service[105759]: X-User-Domain-Id: default Aug 27 02:14:22.164699 dv-cinder-846303-3-smb devstack@n-api.service[105759]: X-User-Domain-Name: Default Aug 27 02:14:22.164699 dv-cinder-846303-3-smb devstack@n-api.service[105759]: X-User-Id: b214a184834a4cb0b49321b412607103 Aug 27 02:14:22.164699 dv-cinder-846303-3-smb devstack@n-api.service[105759]: X-User-Name: admin Aug 27 02:14:22.164699 dv-cinder-846303-3-smb devstack@n-api.service[105759]: method: > Aug 27 02:14:22.164699 dv-cinder-846303-3-smb devstack@n-api.service[105759]: exception: Flavor 42 could not be found. Aug 27 02:14:22.164699 dv-cinder-846303-3-smb devstack@n-api.service[105759]: action_args: {'id': '42'} Aug 27 02:14:22.164699 dv-cinder-846303-3-smb devstack@n-api.service[105759]: {{(pid=105759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:14:22.164699 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:14:22.167125 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 27 02:14:22.167125 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 27 02:14:22.167125 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 27 02:14:22.167125 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 27 02:14:22.167125 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 02:14:22.167125 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 02:14:22.167125 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 27 02:14:22.167125 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 27 02:14:22.167125 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 27 02:14:22.167125 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:14:22.167125 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 27 02:14:22.167125 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 27 02:14:22.167125 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 27 02:14:22.167125 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi Aug 27 02:14:22.167125 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:14:22.167125 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi Aug 27 02:14:22.167125 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:14:22.167125 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:14:22.167125 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:14:22.169575 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:14:22.169575 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:14:22.169575 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:14:22.169575 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:14:22.169575 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 27 02:14:22.169575 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:14:22.169575 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 27 02:14:22.169575 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi Aug 27 02:14:22.169575 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:14:22.169575 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi Aug 27 02:14:22.169575 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:14:22.169575 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:14:22.169575 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:14:22.169575 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:14:22.169575 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:14:22.169575 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 27 02:14:22.169575 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi Aug 27 02:14:22.169575 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi [None req-7d2221cb-1e03-4e38-a895-41468f0b417d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:14:22.172990 dv-cinder-846303-3-smb devstack@n-api.service[105759]: INFO nova.api.openstack.requestlog [None req-7d2221cb-1e03-4e38-a895-41468f0b417d admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.427401 Aug 27 02:14:22.172990 dv-cinder-846303-3-smb devstack@n-api.service[105759]: [pid: 105759|app: 0|req: 19/39] 10.222.0.61 () {60 vars in 1190 bytes} [Sat Aug 27 02:14:21 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 429 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 27 02:14:22.177760 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi [None req-245bd65b-5544-4972-80b7-aa14082dcfec admin admin] Calling method '>' {{(pid=105760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:14:22.182090 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG dbcounter [-] [105760] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=105760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:14:22.203515 dv-cinder-846303-3-smb devstack@n-api.service[105760]: INFO nova.api.openstack.requestlog [None req-245bd65b-5544-4972-80b7-aa14082dcfec admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.029380 Aug 27 02:14:22.204085 dv-cinder-846303-3-smb devstack@n-api.service[105760]: [pid: 105760|app: 0|req: 21/40] 10.222.0.61 () {60 vars in 1210 bytes} [Sat Aug 27 02:14:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:14:22.218417 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi [None req-97e0c1cb-2cf8-4c54-8477-afa06c20649d admin admin] Calling method '>' {{(pid=105759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:14:22.245801 dv-cinder-846303-3-smb devstack@n-api.service[105759]: INFO nova.api.openstack.requestlog [None req-97e0c1cb-2cf8-4c54-8477-afa06c20649d admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.034259 Aug 27 02:14:22.246363 dv-cinder-846303-3-smb devstack@n-api.service[105759]: [pid: 105759|app: 0|req: 20/41] 10.222.0.61 () {60 vars in 1210 bytes} [Sat Aug 27 02:14:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:14:22.256526 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi [None req-3a675c64-1288-4718-9b08-58857cb0baaa admin admin] Calling method '>' {{(pid=105760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:14:22.262880 dv-cinder-846303-3-smb devstack@n-api.service[105760]: INFO nova.api.openstack.wsgi [None req-3a675c64-1288-4718-9b08-58857cb0baaa admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 27 02:14:22.266260 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi [None req-3a675c64-1288-4718-9b08-58857cb0baaa admin admin] Request method failure captured: Aug 27 02:14:22.266260 dv-cinder-846303-3-smb devstack@n-api.service[105760]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 27 02:14:22.266260 dv-cinder-846303-3-smb devstack@n-api.service[105760]: Accept: application/json Aug 27 02:14:22.266260 dv-cinder-846303-3-smb devstack@n-api.service[105760]: Accept-Encoding: gzip, deflate Aug 27 02:14:22.266260 dv-cinder-846303-3-smb devstack@n-api.service[105760]: Connection: keep-alive Aug 27 02:14:22.266260 dv-cinder-846303-3-smb devstack@n-api.service[105760]: Content-Length: 0 Aug 27 02:14:22.266260 dv-cinder-846303-3-smb devstack@n-api.service[105760]: Host: 10.222.0.61 Aug 27 02:14:22.266260 dv-cinder-846303-3-smb devstack@n-api.service[105760]: Openstack-Api-Version: compute 2.90 Aug 27 02:14:22.266260 dv-cinder-846303-3-smb devstack@n-api.service[105760]: Openstack-System-Scope: None Aug 27 02:14:22.266260 dv-cinder-846303-3-smb devstack@n-api.service[105760]: User-Agent: python-novaclient Aug 27 02:14:22.266260 dv-cinder-846303-3-smb devstack@n-api.service[105760]: X-Auth-Token: gAAAAABjCX39Fhn8pSOXQf7kqcuDpIpWWpMJu8OTDvm5wM8aYzQcKaNs0NwGue3htDdWmUHj3FYzKnzRDQtg02HgYOR1zVAECh8Ws1TLyWi3Xs21mETi9RxKoStW6pkOS8kh8jRmAxuZ-O7SarYbD8aLqWAqKSq8QA422RFZnfTNDhcUT5BzrAY Aug 27 02:14:22.266260 dv-cinder-846303-3-smb devstack@n-api.service[105760]: X-Domain-Id: None Aug 27 02:14:22.266260 dv-cinder-846303-3-smb devstack@n-api.service[105760]: X-Domain-Name: None Aug 27 02:14:22.266260 dv-cinder-846303-3-smb devstack@n-api.service[105760]: X-Identity-Status: Confirmed Aug 27 02:14:22.266260 dv-cinder-846303-3-smb devstack@n-api.service[105760]: X-Is-Admin-Project: True Aug 27 02:14:22.266260 dv-cinder-846303-3-smb devstack@n-api.service[105760]: X-Openstack-Nova-Api-Version: 2.90 Aug 27 02:14:22.266260 dv-cinder-846303-3-smb devstack@n-api.service[105760]: X-Project-Domain-Id: default Aug 27 02:14:22.266260 dv-cinder-846303-3-smb devstack@n-api.service[105760]: X-Project-Domain-Name: Default Aug 27 02:14:22.266260 dv-cinder-846303-3-smb devstack@n-api.service[105760]: X-Project-Id: 6316912820d4459d94f37567f9470b42 Aug 27 02:14:22.266260 dv-cinder-846303-3-smb devstack@n-api.service[105760]: X-Project-Name: admin Aug 27 02:14:22.266260 dv-cinder-846303-3-smb devstack@n-api.service[105760]: X-Role: member,admin,reader Aug 27 02:14:22.266260 dv-cinder-846303-3-smb devstack@n-api.service[105760]: X-Roles: member,admin,reader Aug 27 02:14:22.267773 dv-cinder-846303-3-smb devstack@n-api.service[105760]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/6316912820d4459d94f37567f9470b42"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_6316912820d4459d94f37567f9470b42", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6316912820d4459d94f37567f9470b42"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6316912820d4459d94f37567f9470b42"}]}] Aug 27 02:14:22.267773 dv-cinder-846303-3-smb devstack@n-api.service[105760]: X-Tenant: admin Aug 27 02:14:22.267773 dv-cinder-846303-3-smb devstack@n-api.service[105760]: X-Tenant-Id: 6316912820d4459d94f37567f9470b42 Aug 27 02:14:22.267773 dv-cinder-846303-3-smb devstack@n-api.service[105760]: X-Tenant-Name: admin Aug 27 02:14:22.267773 dv-cinder-846303-3-smb devstack@n-api.service[105760]: X-User: admin Aug 27 02:14:22.267773 dv-cinder-846303-3-smb devstack@n-api.service[105760]: X-User-Domain-Id: default Aug 27 02:14:22.267773 dv-cinder-846303-3-smb devstack@n-api.service[105760]: X-User-Domain-Name: Default Aug 27 02:14:22.267773 dv-cinder-846303-3-smb devstack@n-api.service[105760]: X-User-Id: b214a184834a4cb0b49321b412607103 Aug 27 02:14:22.267773 dv-cinder-846303-3-smb devstack@n-api.service[105760]: X-User-Name: admin Aug 27 02:14:22.267773 dv-cinder-846303-3-smb devstack@n-api.service[105760]: method: > Aug 27 02:14:22.267773 dv-cinder-846303-3-smb devstack@n-api.service[105760]: exception: Flavor 42 could not be found. Aug 27 02:14:22.267773 dv-cinder-846303-3-smb devstack@n-api.service[105760]: action_args: {'id': '42'} Aug 27 02:14:22.267773 dv-cinder-846303-3-smb devstack@n-api.service[105760]: {{(pid=105760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:14:22.267773 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:14:22.268674 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 27 02:14:22.268674 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 27 02:14:22.268674 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 27 02:14:22.268674 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 27 02:14:22.268674 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 02:14:22.268674 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 02:14:22.268674 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 27 02:14:22.268674 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 27 02:14:22.268674 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 27 02:14:22.268674 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:14:22.268674 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 27 02:14:22.268674 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 27 02:14:22.268674 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 27 02:14:22.268674 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi Aug 27 02:14:22.268674 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:14:22.268674 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi Aug 27 02:14:22.268674 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:14:22.268674 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:14:22.268674 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:14:22.269807 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:14:22.269807 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:14:22.269807 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:14:22.269807 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:14:22.269807 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 27 02:14:22.269807 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:14:22.269807 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 27 02:14:22.269807 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi Aug 27 02:14:22.269807 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:14:22.269807 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi Aug 27 02:14:22.269807 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:14:22.269807 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:14:22.269807 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:14:22.269807 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:14:22.269807 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:14:22.269807 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 27 02:14:22.269807 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi Aug 27 02:14:22.269807 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi [None req-3a675c64-1288-4718-9b08-58857cb0baaa admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105760) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:14:22.270968 dv-cinder-846303-3-smb devstack@n-api.service[105760]: INFO nova.api.openstack.requestlog [None req-3a675c64-1288-4718-9b08-58857cb0baaa admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015334 Aug 27 02:14:22.270968 dv-cinder-846303-3-smb devstack@n-api.service[105760]: [pid: 105760|app: 0|req: 22/42] 10.222.0.61 () {60 vars in 1190 bytes} [Sat Aug 27 02:14:22 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 27 02:14:23.257414 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi [None req-97e0c1cb-2cf8-4c54-8477-afa06c20649d admin admin] Calling method '>' {{(pid=105759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:14:23.258486 dv-cinder-846303-3-smb devstack@n-api.service[105759]: INFO nova.api.openstack.requestlog [None req-97e0c1cb-2cf8-4c54-8477-afa06c20649d admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001917 Aug 27 02:14:23.259034 dv-cinder-846303-3-smb devstack@n-api.service[105759]: [pid: 105759|app: 0|req: 21/43] 10.222.0.61 () {56 vars in 1074 bytes} [Sat Aug 27 02:14:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:14:23.824910 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi [None req-190d1b55-093b-49ec-8c25-d5941346bb22 admin admin] Calling method '>' {{(pid=105760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:14:23.832657 dv-cinder-846303-3-smb devstack@n-api.service[105760]: INFO nova.api.openstack.wsgi [None req-190d1b55-093b-49ec-8c25-d5941346bb22 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 27 02:14:23.834229 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi [None req-190d1b55-093b-49ec-8c25-d5941346bb22 admin admin] Request method failure captured: Aug 27 02:14:23.834229 dv-cinder-846303-3-smb devstack@n-api.service[105760]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 27 02:14:23.834229 dv-cinder-846303-3-smb devstack@n-api.service[105760]: Accept: application/json Aug 27 02:14:23.834229 dv-cinder-846303-3-smb devstack@n-api.service[105760]: Accept-Encoding: gzip, deflate Aug 27 02:14:23.834229 dv-cinder-846303-3-smb devstack@n-api.service[105760]: Connection: keep-alive Aug 27 02:14:23.834229 dv-cinder-846303-3-smb devstack@n-api.service[105760]: Content-Length: 0 Aug 27 02:14:23.834229 dv-cinder-846303-3-smb devstack@n-api.service[105760]: Host: 10.222.0.61 Aug 27 02:14:23.834229 dv-cinder-846303-3-smb devstack@n-api.service[105760]: Openstack-Api-Version: compute 2.90 Aug 27 02:14:23.834229 dv-cinder-846303-3-smb devstack@n-api.service[105760]: Openstack-System-Scope: None Aug 27 02:14:23.834229 dv-cinder-846303-3-smb devstack@n-api.service[105760]: User-Agent: python-novaclient Aug 27 02:14:23.834229 dv-cinder-846303-3-smb devstack@n-api.service[105760]: X-Auth-Token: gAAAAABjCX3_n3oTTGQHIUVDVG1tD_QL76gVbb-ZOTmC5cRmN_dQu17YpXyJOTaTP6BMXPUIGXA31-m4F4A8YR4-0mgR_AVoEgXWItiI-NrEePK_Bp3tAxLXC7RJ8ybVx4jTceIkuBc9atu_XEj4JOHPBvDjEs3emyF97qbTXUitM10lit-Do6w Aug 27 02:14:23.834229 dv-cinder-846303-3-smb devstack@n-api.service[105760]: X-Domain-Id: None Aug 27 02:14:23.834229 dv-cinder-846303-3-smb devstack@n-api.service[105760]: X-Domain-Name: None Aug 27 02:14:23.834229 dv-cinder-846303-3-smb devstack@n-api.service[105760]: X-Identity-Status: Confirmed Aug 27 02:14:23.834229 dv-cinder-846303-3-smb devstack@n-api.service[105760]: X-Is-Admin-Project: True Aug 27 02:14:23.834229 dv-cinder-846303-3-smb devstack@n-api.service[105760]: X-Openstack-Nova-Api-Version: 2.90 Aug 27 02:14:23.834229 dv-cinder-846303-3-smb devstack@n-api.service[105760]: X-Project-Domain-Id: default Aug 27 02:14:23.834229 dv-cinder-846303-3-smb devstack@n-api.service[105760]: X-Project-Domain-Name: Default Aug 27 02:14:23.834229 dv-cinder-846303-3-smb devstack@n-api.service[105760]: X-Project-Id: 6316912820d4459d94f37567f9470b42 Aug 27 02:14:23.834229 dv-cinder-846303-3-smb devstack@n-api.service[105760]: X-Project-Name: admin Aug 27 02:14:23.834229 dv-cinder-846303-3-smb devstack@n-api.service[105760]: X-Role: member,admin,reader Aug 27 02:14:23.834229 dv-cinder-846303-3-smb devstack@n-api.service[105760]: X-Roles: member,admin,reader Aug 27 02:14:23.835527 dv-cinder-846303-3-smb devstack@n-api.service[105760]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/6316912820d4459d94f37567f9470b42"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_6316912820d4459d94f37567f9470b42", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6316912820d4459d94f37567f9470b42"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6316912820d4459d94f37567f9470b42"}]}] Aug 27 02:14:23.835527 dv-cinder-846303-3-smb devstack@n-api.service[105760]: X-Tenant: admin Aug 27 02:14:23.835527 dv-cinder-846303-3-smb devstack@n-api.service[105760]: X-Tenant-Id: 6316912820d4459d94f37567f9470b42 Aug 27 02:14:23.835527 dv-cinder-846303-3-smb devstack@n-api.service[105760]: X-Tenant-Name: admin Aug 27 02:14:23.835527 dv-cinder-846303-3-smb devstack@n-api.service[105760]: X-User: admin Aug 27 02:14:23.835527 dv-cinder-846303-3-smb devstack@n-api.service[105760]: X-User-Domain-Id: default Aug 27 02:14:23.835527 dv-cinder-846303-3-smb devstack@n-api.service[105760]: X-User-Domain-Name: Default Aug 27 02:14:23.835527 dv-cinder-846303-3-smb devstack@n-api.service[105760]: X-User-Id: b214a184834a4cb0b49321b412607103 Aug 27 02:14:23.835527 dv-cinder-846303-3-smb devstack@n-api.service[105760]: X-User-Name: admin Aug 27 02:14:23.835527 dv-cinder-846303-3-smb devstack@n-api.service[105760]: method: > Aug 27 02:14:23.835527 dv-cinder-846303-3-smb devstack@n-api.service[105760]: exception: Flavor 84 could not be found. Aug 27 02:14:23.835527 dv-cinder-846303-3-smb devstack@n-api.service[105760]: action_args: {'id': '84'} Aug 27 02:14:23.835527 dv-cinder-846303-3-smb devstack@n-api.service[105760]: {{(pid=105760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:14:23.835527 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:14:23.836301 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 27 02:14:23.836301 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 27 02:14:23.836301 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 27 02:14:23.836301 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 27 02:14:23.836301 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 02:14:23.836301 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 02:14:23.836301 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 27 02:14:23.836301 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 27 02:14:23.836301 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 27 02:14:23.836301 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:14:23.836301 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 27 02:14:23.836301 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 27 02:14:23.836301 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 27 02:14:23.836301 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi Aug 27 02:14:23.836301 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:14:23.836301 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi Aug 27 02:14:23.836301 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:14:23.836301 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:14:23.836301 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:14:23.837507 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:14:23.837507 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:14:23.837507 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:14:23.837507 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:14:23.837507 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 27 02:14:23.837507 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:14:23.837507 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 27 02:14:23.837507 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi Aug 27 02:14:23.837507 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:14:23.837507 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi Aug 27 02:14:23.837507 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:14:23.837507 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:14:23.837507 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:14:23.837507 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:14:23.837507 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:14:23.837507 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 27 02:14:23.837507 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi Aug 27 02:14:23.837507 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi [None req-190d1b55-093b-49ec-8c25-d5941346bb22 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105760) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:14:23.838656 dv-cinder-846303-3-smb devstack@n-api.service[105760]: INFO nova.api.openstack.requestlog [None req-190d1b55-093b-49ec-8c25-d5941346bb22 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.440722 Aug 27 02:14:23.838656 dv-cinder-846303-3-smb devstack@n-api.service[105760]: [pid: 105760|app: 0|req: 23/44] 10.222.0.61 () {60 vars in 1190 bytes} [Sat Aug 27 02:14:23 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 442 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 27 02:14:23.850464 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi [None req-eaae41b9-5336-4983-90d4-283e94393f22 admin admin] Calling method '>' {{(pid=105759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:14:23.869151 dv-cinder-846303-3-smb devstack@n-api.service[105759]: INFO nova.api.openstack.requestlog [None req-eaae41b9-5336-4983-90d4-283e94393f22 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024117 Aug 27 02:14:23.869752 dv-cinder-846303-3-smb devstack@n-api.service[105759]: [pid: 105759|app: 0|req: 22/45] 10.222.0.61 () {60 vars in 1210 bytes} [Sat Aug 27 02:14:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:14:23.880262 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi [None req-583ef8cb-d4e8-4d96-acdc-8a4390fea004 admin admin] Calling method '>' {{(pid=105760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:14:23.896394 dv-cinder-846303-3-smb devstack@n-api.service[105760]: INFO nova.api.openstack.requestlog [None req-583ef8cb-d4e8-4d96-acdc-8a4390fea004 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019572 Aug 27 02:14:23.897270 dv-cinder-846303-3-smb devstack@n-api.service[105760]: [pid: 105760|app: 0|req: 24/46] 10.222.0.61 () {60 vars in 1210 bytes} [Sat Aug 27 02:14:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:14:23.908601 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi [None req-d9aa4ada-04e6-461f-acc4-3e54750e1397 admin admin] Calling method '>' {{(pid=105759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:14:23.914794 dv-cinder-846303-3-smb devstack@n-api.service[105759]: INFO nova.api.openstack.wsgi [None req-d9aa4ada-04e6-461f-acc4-3e54750e1397 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 27 02:14:23.916736 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi [None req-d9aa4ada-04e6-461f-acc4-3e54750e1397 admin admin] Request method failure captured: Aug 27 02:14:23.916736 dv-cinder-846303-3-smb devstack@n-api.service[105759]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 27 02:14:23.916736 dv-cinder-846303-3-smb devstack@n-api.service[105759]: Accept: application/json Aug 27 02:14:23.916736 dv-cinder-846303-3-smb devstack@n-api.service[105759]: Accept-Encoding: gzip, deflate Aug 27 02:14:23.916736 dv-cinder-846303-3-smb devstack@n-api.service[105759]: Connection: keep-alive Aug 27 02:14:23.916736 dv-cinder-846303-3-smb devstack@n-api.service[105759]: Content-Length: 0 Aug 27 02:14:23.916736 dv-cinder-846303-3-smb devstack@n-api.service[105759]: Host: 10.222.0.61 Aug 27 02:14:23.916736 dv-cinder-846303-3-smb devstack@n-api.service[105759]: Openstack-Api-Version: compute 2.90 Aug 27 02:14:23.916736 dv-cinder-846303-3-smb devstack@n-api.service[105759]: Openstack-System-Scope: None Aug 27 02:14:23.916736 dv-cinder-846303-3-smb devstack@n-api.service[105759]: User-Agent: python-novaclient Aug 27 02:14:23.916736 dv-cinder-846303-3-smb devstack@n-api.service[105759]: X-Auth-Token: gAAAAABjCX3_n3oTTGQHIUVDVG1tD_QL76gVbb-ZOTmC5cRmN_dQu17YpXyJOTaTP6BMXPUIGXA31-m4F4A8YR4-0mgR_AVoEgXWItiI-NrEePK_Bp3tAxLXC7RJ8ybVx4jTceIkuBc9atu_XEj4JOHPBvDjEs3emyF97qbTXUitM10lit-Do6w Aug 27 02:14:23.916736 dv-cinder-846303-3-smb devstack@n-api.service[105759]: X-Domain-Id: None Aug 27 02:14:23.916736 dv-cinder-846303-3-smb devstack@n-api.service[105759]: X-Domain-Name: None Aug 27 02:14:23.916736 dv-cinder-846303-3-smb devstack@n-api.service[105759]: X-Identity-Status: Confirmed Aug 27 02:14:23.916736 dv-cinder-846303-3-smb devstack@n-api.service[105759]: X-Is-Admin-Project: True Aug 27 02:14:23.916736 dv-cinder-846303-3-smb devstack@n-api.service[105759]: X-Openstack-Nova-Api-Version: 2.90 Aug 27 02:14:23.916736 dv-cinder-846303-3-smb devstack@n-api.service[105759]: X-Project-Domain-Id: default Aug 27 02:14:23.916736 dv-cinder-846303-3-smb devstack@n-api.service[105759]: X-Project-Domain-Name: Default Aug 27 02:14:23.916736 dv-cinder-846303-3-smb devstack@n-api.service[105759]: X-Project-Id: 6316912820d4459d94f37567f9470b42 Aug 27 02:14:23.916736 dv-cinder-846303-3-smb devstack@n-api.service[105759]: X-Project-Name: admin Aug 27 02:14:23.916736 dv-cinder-846303-3-smb devstack@n-api.service[105759]: X-Role: member,admin,reader Aug 27 02:14:23.916736 dv-cinder-846303-3-smb devstack@n-api.service[105759]: X-Roles: member,admin,reader Aug 27 02:14:23.918325 dv-cinder-846303-3-smb devstack@n-api.service[105759]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/6316912820d4459d94f37567f9470b42"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_6316912820d4459d94f37567f9470b42", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6316912820d4459d94f37567f9470b42"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6316912820d4459d94f37567f9470b42"}]}] Aug 27 02:14:23.918325 dv-cinder-846303-3-smb devstack@n-api.service[105759]: X-Tenant: admin Aug 27 02:14:23.918325 dv-cinder-846303-3-smb devstack@n-api.service[105759]: X-Tenant-Id: 6316912820d4459d94f37567f9470b42 Aug 27 02:14:23.918325 dv-cinder-846303-3-smb devstack@n-api.service[105759]: X-Tenant-Name: admin Aug 27 02:14:23.918325 dv-cinder-846303-3-smb devstack@n-api.service[105759]: X-User: admin Aug 27 02:14:23.918325 dv-cinder-846303-3-smb devstack@n-api.service[105759]: X-User-Domain-Id: default Aug 27 02:14:23.918325 dv-cinder-846303-3-smb devstack@n-api.service[105759]: X-User-Domain-Name: Default Aug 27 02:14:23.918325 dv-cinder-846303-3-smb devstack@n-api.service[105759]: X-User-Id: b214a184834a4cb0b49321b412607103 Aug 27 02:14:23.918325 dv-cinder-846303-3-smb devstack@n-api.service[105759]: X-User-Name: admin Aug 27 02:14:23.918325 dv-cinder-846303-3-smb devstack@n-api.service[105759]: method: > Aug 27 02:14:23.918325 dv-cinder-846303-3-smb devstack@n-api.service[105759]: exception: Flavor 84 could not be found. Aug 27 02:14:23.918325 dv-cinder-846303-3-smb devstack@n-api.service[105759]: action_args: {'id': '84'} Aug 27 02:14:23.918325 dv-cinder-846303-3-smb devstack@n-api.service[105759]: {{(pid=105759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:14:23.918325 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:14:23.919345 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 27 02:14:23.919345 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 27 02:14:23.919345 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 27 02:14:23.919345 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 27 02:14:23.919345 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 02:14:23.919345 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 02:14:23.919345 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 27 02:14:23.919345 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 27 02:14:23.919345 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 27 02:14:23.919345 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:14:23.919345 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 27 02:14:23.919345 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 27 02:14:23.919345 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 27 02:14:23.919345 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi Aug 27 02:14:23.919345 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:14:23.919345 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi Aug 27 02:14:23.919345 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:14:23.919345 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:14:23.919345 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:14:23.920789 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:14:23.920789 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:14:23.920789 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:14:23.920789 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:14:23.920789 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 27 02:14:23.920789 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:14:23.920789 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 27 02:14:23.920789 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi Aug 27 02:14:23.920789 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:14:23.920789 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi Aug 27 02:14:23.920789 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:14:23.920789 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:14:23.920789 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:14:23.920789 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:14:23.920789 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:14:23.920789 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 27 02:14:23.920789 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi Aug 27 02:14:23.920789 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi [None req-d9aa4ada-04e6-461f-acc4-3e54750e1397 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:14:23.922166 dv-cinder-846303-3-smb devstack@n-api.service[105759]: INFO nova.api.openstack.requestlog [None req-d9aa4ada-04e6-461f-acc4-3e54750e1397 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.014783 Aug 27 02:14:23.922166 dv-cinder-846303-3-smb devstack@n-api.service[105759]: [pid: 105759|app: 0|req: 23/47] 10.222.0.61 () {60 vars in 1190 bytes} [Sat Aug 27 02:14:23 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 27 02:14:24.918765 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi [None req-583ef8cb-d4e8-4d96-acdc-8a4390fea004 admin admin] Calling method '>' {{(pid=105760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:14:24.919768 dv-cinder-846303-3-smb devstack@n-api.service[105760]: INFO nova.api.openstack.requestlog [None req-583ef8cb-d4e8-4d96-acdc-8a4390fea004 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Aug 27 02:14:24.920163 dv-cinder-846303-3-smb devstack@n-api.service[105760]: [pid: 105760|app: 0|req: 25/48] 10.222.0.61 () {56 vars in 1074 bytes} [Sat Aug 27 02:14:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:14:25.502557 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi [None req-9147d32a-67dc-41be-921f-fbeb19c4ccdb admin admin] Calling method '>' {{(pid=105759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:14:25.509440 dv-cinder-846303-3-smb devstack@n-api.service[105759]: INFO nova.api.openstack.wsgi [None req-9147d32a-67dc-41be-921f-fbeb19c4ccdb admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 27 02:14:25.511330 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi [None req-9147d32a-67dc-41be-921f-fbeb19c4ccdb admin admin] Request method failure captured: Aug 27 02:14:25.511330 dv-cinder-846303-3-smb devstack@n-api.service[105759]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 27 02:14:25.511330 dv-cinder-846303-3-smb devstack@n-api.service[105759]: Accept: application/json Aug 27 02:14:25.511330 dv-cinder-846303-3-smb devstack@n-api.service[105759]: Accept-Encoding: gzip, deflate Aug 27 02:14:25.511330 dv-cinder-846303-3-smb devstack@n-api.service[105759]: Connection: keep-alive Aug 27 02:14:25.511330 dv-cinder-846303-3-smb devstack@n-api.service[105759]: Content-Length: 0 Aug 27 02:14:25.511330 dv-cinder-846303-3-smb devstack@n-api.service[105759]: Host: 10.222.0.61 Aug 27 02:14:25.511330 dv-cinder-846303-3-smb devstack@n-api.service[105759]: Openstack-Api-Version: compute 2.90 Aug 27 02:14:25.511330 dv-cinder-846303-3-smb devstack@n-api.service[105759]: Openstack-System-Scope: None Aug 27 02:14:25.511330 dv-cinder-846303-3-smb devstack@n-api.service[105759]: User-Agent: python-novaclient Aug 27 02:14:25.511330 dv-cinder-846303-3-smb devstack@n-api.service[105759]: X-Auth-Token: gAAAAABjCX4AVqbY7CZgEHSzEpUx9v95L1ZWPp2Kp9ZItO4x7StphiNIW8hQYNzV3GTQxRdu9sk95cwRD6t5QrbhmviRPTnTz-Ryb0UzFg2G-EEPu5SBmAt7PTMg7dojAK-mUwOXwLG-0K42-FucLM5cHI9GUC_WNE90uJKtg5FIV4S2zmpLSgA Aug 27 02:14:25.511330 dv-cinder-846303-3-smb devstack@n-api.service[105759]: X-Domain-Id: None Aug 27 02:14:25.511330 dv-cinder-846303-3-smb devstack@n-api.service[105759]: X-Domain-Name: None Aug 27 02:14:25.511330 dv-cinder-846303-3-smb devstack@n-api.service[105759]: X-Identity-Status: Confirmed Aug 27 02:14:25.511330 dv-cinder-846303-3-smb devstack@n-api.service[105759]: X-Is-Admin-Project: True Aug 27 02:14:25.511330 dv-cinder-846303-3-smb devstack@n-api.service[105759]: X-Openstack-Nova-Api-Version: 2.90 Aug 27 02:14:25.511330 dv-cinder-846303-3-smb devstack@n-api.service[105759]: X-Project-Domain-Id: default Aug 27 02:14:25.511330 dv-cinder-846303-3-smb devstack@n-api.service[105759]: X-Project-Domain-Name: Default Aug 27 02:14:25.511330 dv-cinder-846303-3-smb devstack@n-api.service[105759]: X-Project-Id: 6316912820d4459d94f37567f9470b42 Aug 27 02:14:25.511330 dv-cinder-846303-3-smb devstack@n-api.service[105759]: X-Project-Name: admin Aug 27 02:14:25.511330 dv-cinder-846303-3-smb devstack@n-api.service[105759]: X-Role: member,admin,reader Aug 27 02:14:25.511330 dv-cinder-846303-3-smb devstack@n-api.service[105759]: X-Roles: member,admin,reader Aug 27 02:14:25.513098 dv-cinder-846303-3-smb devstack@n-api.service[105759]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/6316912820d4459d94f37567f9470b42"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_6316912820d4459d94f37567f9470b42", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6316912820d4459d94f37567f9470b42"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6316912820d4459d94f37567f9470b42"}]}] Aug 27 02:14:25.513098 dv-cinder-846303-3-smb devstack@n-api.service[105759]: X-Tenant: admin Aug 27 02:14:25.513098 dv-cinder-846303-3-smb devstack@n-api.service[105759]: X-Tenant-Id: 6316912820d4459d94f37567f9470b42 Aug 27 02:14:25.513098 dv-cinder-846303-3-smb devstack@n-api.service[105759]: X-Tenant-Name: admin Aug 27 02:14:25.513098 dv-cinder-846303-3-smb devstack@n-api.service[105759]: X-User: admin Aug 27 02:14:25.513098 dv-cinder-846303-3-smb devstack@n-api.service[105759]: X-User-Domain-Id: default Aug 27 02:14:25.513098 dv-cinder-846303-3-smb devstack@n-api.service[105759]: X-User-Domain-Name: Default Aug 27 02:14:25.513098 dv-cinder-846303-3-smb devstack@n-api.service[105759]: X-User-Id: b214a184834a4cb0b49321b412607103 Aug 27 02:14:25.513098 dv-cinder-846303-3-smb devstack@n-api.service[105759]: X-User-Name: admin Aug 27 02:14:25.513098 dv-cinder-846303-3-smb devstack@n-api.service[105759]: method: > Aug 27 02:14:25.513098 dv-cinder-846303-3-smb devstack@n-api.service[105759]: exception: Flavor 451 could not be found. Aug 27 02:14:25.513098 dv-cinder-846303-3-smb devstack@n-api.service[105759]: action_args: {'id': '451'} Aug 27 02:14:25.513098 dv-cinder-846303-3-smb devstack@n-api.service[105759]: {{(pid=105759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:14:25.513098 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:14:25.513946 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 27 02:14:25.513946 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 27 02:14:25.513946 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 27 02:14:25.513946 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 27 02:14:25.513946 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 02:14:25.513946 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 02:14:25.513946 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 27 02:14:25.513946 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 27 02:14:25.513946 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 27 02:14:25.513946 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:14:25.513946 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 27 02:14:25.513946 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 27 02:14:25.513946 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 27 02:14:25.513946 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi Aug 27 02:14:25.513946 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:14:25.513946 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi Aug 27 02:14:25.513946 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:14:25.513946 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:14:25.513946 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:14:25.515032 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:14:25.515032 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:14:25.515032 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:14:25.515032 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:14:25.515032 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 27 02:14:25.515032 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:14:25.515032 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 27 02:14:25.515032 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi Aug 27 02:14:25.515032 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:14:25.515032 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi Aug 27 02:14:25.515032 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:14:25.515032 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:14:25.515032 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:14:25.515032 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:14:25.515032 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:14:25.515032 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 27 02:14:25.515032 dv-cinder-846303-3-smb devstack@n-api.service[105759]: ERROR nova.api.openstack.wsgi Aug 27 02:14:25.515032 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi [None req-9147d32a-67dc-41be-921f-fbeb19c4ccdb admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:14:25.516114 dv-cinder-846303-3-smb devstack@n-api.service[105759]: INFO nova.api.openstack.requestlog [None req-9147d32a-67dc-41be-921f-fbeb19c4ccdb admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.452661 Aug 27 02:14:25.516114 dv-cinder-846303-3-smb devstack@n-api.service[105759]: [pid: 105759|app: 0|req: 24/49] 10.222.0.61 () {60 vars in 1193 bytes} [Sat Aug 27 02:14:25 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 454 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 27 02:14:25.523342 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi [None req-f0d91bb0-65e6-4769-9a23-7a62b50843be admin admin] Calling method '>' {{(pid=105760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:14:25.538421 dv-cinder-846303-3-smb devstack@n-api.service[105760]: INFO nova.api.openstack.requestlog [None req-f0d91bb0-65e6-4769-9a23-7a62b50843be admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018946 Aug 27 02:14:25.538991 dv-cinder-846303-3-smb devstack@n-api.service[105760]: [pid: 105760|app: 0|req: 26/50] 10.222.0.61 () {60 vars in 1210 bytes} [Sat Aug 27 02:14:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:14:25.549142 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi [None req-2e854ccd-40f4-451f-9f8f-d01567dd5578 admin admin] Calling method '>' {{(pid=105759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:14:25.567154 dv-cinder-846303-3-smb devstack@n-api.service[105759]: INFO nova.api.openstack.requestlog [None req-2e854ccd-40f4-451f-9f8f-d01567dd5578 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.021354 Aug 27 02:14:25.567757 dv-cinder-846303-3-smb devstack@n-api.service[105759]: [pid: 105759|app: 0|req: 25/51] 10.222.0.61 () {60 vars in 1210 bytes} [Sat Aug 27 02:14:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:14:25.582560 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi [None req-82854e60-b556-4b7e-9f28-02d3c81beb0e admin admin] Calling method '>' {{(pid=105760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:14:25.590158 dv-cinder-846303-3-smb devstack@n-api.service[105760]: INFO nova.api.openstack.wsgi [None req-82854e60-b556-4b7e-9f28-02d3c81beb0e admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 27 02:14:25.591649 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi [None req-82854e60-b556-4b7e-9f28-02d3c81beb0e admin admin] Request method failure captured: Aug 27 02:14:25.591649 dv-cinder-846303-3-smb devstack@n-api.service[105760]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 27 02:14:25.591649 dv-cinder-846303-3-smb devstack@n-api.service[105760]: Accept: application/json Aug 27 02:14:25.591649 dv-cinder-846303-3-smb devstack@n-api.service[105760]: Accept-Encoding: gzip, deflate Aug 27 02:14:25.591649 dv-cinder-846303-3-smb devstack@n-api.service[105760]: Connection: keep-alive Aug 27 02:14:25.591649 dv-cinder-846303-3-smb devstack@n-api.service[105760]: Content-Length: 0 Aug 27 02:14:25.591649 dv-cinder-846303-3-smb devstack@n-api.service[105760]: Host: 10.222.0.61 Aug 27 02:14:25.591649 dv-cinder-846303-3-smb devstack@n-api.service[105760]: Openstack-Api-Version: compute 2.90 Aug 27 02:14:25.591649 dv-cinder-846303-3-smb devstack@n-api.service[105760]: Openstack-System-Scope: None Aug 27 02:14:25.591649 dv-cinder-846303-3-smb devstack@n-api.service[105760]: User-Agent: python-novaclient Aug 27 02:14:25.591649 dv-cinder-846303-3-smb devstack@n-api.service[105760]: X-Auth-Token: gAAAAABjCX4AVqbY7CZgEHSzEpUx9v95L1ZWPp2Kp9ZItO4x7StphiNIW8hQYNzV3GTQxRdu9sk95cwRD6t5QrbhmviRPTnTz-Ryb0UzFg2G-EEPu5SBmAt7PTMg7dojAK-mUwOXwLG-0K42-FucLM5cHI9GUC_WNE90uJKtg5FIV4S2zmpLSgA Aug 27 02:14:25.591649 dv-cinder-846303-3-smb devstack@n-api.service[105760]: X-Domain-Id: None Aug 27 02:14:25.591649 dv-cinder-846303-3-smb devstack@n-api.service[105760]: X-Domain-Name: None Aug 27 02:14:25.591649 dv-cinder-846303-3-smb devstack@n-api.service[105760]: X-Identity-Status: Confirmed Aug 27 02:14:25.591649 dv-cinder-846303-3-smb devstack@n-api.service[105760]: X-Is-Admin-Project: True Aug 27 02:14:25.591649 dv-cinder-846303-3-smb devstack@n-api.service[105760]: X-Openstack-Nova-Api-Version: 2.90 Aug 27 02:14:25.591649 dv-cinder-846303-3-smb devstack@n-api.service[105760]: X-Project-Domain-Id: default Aug 27 02:14:25.591649 dv-cinder-846303-3-smb devstack@n-api.service[105760]: X-Project-Domain-Name: Default Aug 27 02:14:25.591649 dv-cinder-846303-3-smb devstack@n-api.service[105760]: X-Project-Id: 6316912820d4459d94f37567f9470b42 Aug 27 02:14:25.591649 dv-cinder-846303-3-smb devstack@n-api.service[105760]: X-Project-Name: admin Aug 27 02:14:25.591649 dv-cinder-846303-3-smb devstack@n-api.service[105760]: X-Role: member,admin,reader Aug 27 02:14:25.591649 dv-cinder-846303-3-smb devstack@n-api.service[105760]: X-Roles: member,admin,reader Aug 27 02:14:25.593252 dv-cinder-846303-3-smb devstack@n-api.service[105760]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/6316912820d4459d94f37567f9470b42"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_6316912820d4459d94f37567f9470b42", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6316912820d4459d94f37567f9470b42"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6316912820d4459d94f37567f9470b42"}]}] Aug 27 02:14:25.593252 dv-cinder-846303-3-smb devstack@n-api.service[105760]: X-Tenant: admin Aug 27 02:14:25.593252 dv-cinder-846303-3-smb devstack@n-api.service[105760]: X-Tenant-Id: 6316912820d4459d94f37567f9470b42 Aug 27 02:14:25.593252 dv-cinder-846303-3-smb devstack@n-api.service[105760]: X-Tenant-Name: admin Aug 27 02:14:25.593252 dv-cinder-846303-3-smb devstack@n-api.service[105760]: X-User: admin Aug 27 02:14:25.593252 dv-cinder-846303-3-smb devstack@n-api.service[105760]: X-User-Domain-Id: default Aug 27 02:14:25.593252 dv-cinder-846303-3-smb devstack@n-api.service[105760]: X-User-Domain-Name: Default Aug 27 02:14:25.593252 dv-cinder-846303-3-smb devstack@n-api.service[105760]: X-User-Id: b214a184834a4cb0b49321b412607103 Aug 27 02:14:25.593252 dv-cinder-846303-3-smb devstack@n-api.service[105760]: X-User-Name: admin Aug 27 02:14:25.593252 dv-cinder-846303-3-smb devstack@n-api.service[105760]: method: > Aug 27 02:14:25.593252 dv-cinder-846303-3-smb devstack@n-api.service[105760]: exception: Flavor 451 could not be found. Aug 27 02:14:25.593252 dv-cinder-846303-3-smb devstack@n-api.service[105760]: action_args: {'id': '451'} Aug 27 02:14:25.593252 dv-cinder-846303-3-smb devstack@n-api.service[105760]: {{(pid=105760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:14:25.593252 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:14:25.594630 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 27 02:14:25.594630 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 27 02:14:25.594630 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 27 02:14:25.594630 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 27 02:14:25.594630 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 02:14:25.594630 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 02:14:25.594630 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 27 02:14:25.594630 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 27 02:14:25.594630 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 27 02:14:25.594630 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:14:25.594630 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 27 02:14:25.594630 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 27 02:14:25.594630 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 27 02:14:25.594630 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi Aug 27 02:14:25.594630 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:14:25.594630 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi Aug 27 02:14:25.594630 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:14:25.594630 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:14:25.594630 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:14:25.596560 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:14:25.596560 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:14:25.596560 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:14:25.596560 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:14:25.596560 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 27 02:14:25.596560 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:14:25.596560 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 27 02:14:25.596560 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi Aug 27 02:14:25.596560 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:14:25.596560 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi Aug 27 02:14:25.596560 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:14:25.596560 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:14:25.596560 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:14:25.596560 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:14:25.596560 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:14:25.596560 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 27 02:14:25.596560 dv-cinder-846303-3-smb devstack@n-api.service[105760]: ERROR nova.api.openstack.wsgi Aug 27 02:14:25.596560 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi [None req-82854e60-b556-4b7e-9f28-02d3c81beb0e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105760) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:14:25.598446 dv-cinder-846303-3-smb devstack@n-api.service[105760]: INFO nova.api.openstack.requestlog [None req-82854e60-b556-4b7e-9f28-02d3c81beb0e admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.014679 Aug 27 02:14:25.598446 dv-cinder-846303-3-smb devstack@n-api.service[105760]: [pid: 105760|app: 0|req: 27/52] 10.222.0.61 () {60 vars in 1193 bytes} [Sat Aug 27 02:14:25 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 27 02:14:26.590348 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi [None req-2e854ccd-40f4-451f-9f8f-d01567dd5578 admin admin] Calling method '>' {{(pid=105759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:14:26.591380 dv-cinder-846303-3-smb devstack@n-api.service[105759]: INFO nova.api.openstack.requestlog [None req-2e854ccd-40f4-451f-9f8f-d01567dd5578 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001638 Aug 27 02:14:26.591770 dv-cinder-846303-3-smb devstack@n-api.service[105759]: [pid: 105759|app: 0|req: 26/53] 10.222.0.61 () {56 vars in 1074 bytes} [Sat Aug 27 02:14:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:14:27.178355 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi [None req-d09820d7-ad2f-475a-9c51-8881ad628502 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:14:27.199064 dv-cinder-846303-3-smb devstack@n-api.service[105760]: INFO nova.api.openstack.requestlog [None req-d09820d7-ad2f-475a-9c51-8881ad628502 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.465654 Aug 27 02:14:27.199830 dv-cinder-846303-3-smb devstack@n-api.service[105760]: [pid: 105760|app: 0|req: 28/54] 10.222.0.61 () {64 vars in 1235 bytes} [Sat Aug 27 02:14:26 2022] POST /compute/v2.1/flavors => generated 404 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:14:28.200834 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi [None req-2e854ccd-40f4-451f-9f8f-d01567dd5578 admin admin] Calling method '>' {{(pid=105759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:14:28.201880 dv-cinder-846303-3-smb devstack@n-api.service[105759]: INFO nova.api.openstack.requestlog [None req-2e854ccd-40f4-451f-9f8f-d01567dd5578 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 Aug 27 02:14:28.202267 dv-cinder-846303-3-smb devstack@n-api.service[105759]: [pid: 105759|app: 0|req: 27/55] 10.222.0.61 () {56 vars in 1074 bytes} [Sat Aug 27 02:14:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:14:28.763219 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi [None req-6c3c3d67-7f29-4ea4-8307-d785ff03e8bd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:14:28.784262 dv-cinder-846303-3-smb devstack@n-api.service[105760]: INFO nova.api.openstack.requestlog [None req-6c3c3d67-7f29-4ea4-8307-d785ff03e8bd admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.441841 Aug 27 02:14:28.784813 dv-cinder-846303-3-smb devstack@n-api.service[105760]: [pid: 105760|app: 0|req: 29/56] 10.222.0.61 () {64 vars in 1235 bytes} [Sat Aug 27 02:14:28 2022] POST /compute/v2.1/flavors => generated 405 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:14:29.768393 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi [None req-2e854ccd-40f4-451f-9f8f-d01567dd5578 admin admin] Calling method '>' {{(pid=105759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:14:29.769415 dv-cinder-846303-3-smb devstack@n-api.service[105759]: INFO nova.api.openstack.requestlog [None req-2e854ccd-40f4-451f-9f8f-d01567dd5578 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Aug 27 02:14:29.769845 dv-cinder-846303-3-smb devstack@n-api.service[105759]: [pid: 105759|app: 0|req: 28/57] 10.222.0.61 () {56 vars in 1074 bytes} [Sat Aug 27 02:14:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:14:30.301138 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi [None req-a928b988-d92c-4729-8f4b-7269b44b82fe admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:14:30.321883 dv-cinder-846303-3-smb devstack@n-api.service[105760]: INFO nova.api.openstack.requestlog [None req-a928b988-d92c-4729-8f4b-7269b44b82fe admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.415268 Aug 27 02:14:30.322425 dv-cinder-846303-3-smb devstack@n-api.service[105760]: [pid: 105760|app: 0|req: 30/58] 10.222.0.61 () {64 vars in 1235 bytes} [Sat Aug 27 02:14:29 2022] POST /compute/v2.1/flavors => generated 407 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:14:31.291715 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi [None req-2e854ccd-40f4-451f-9f8f-d01567dd5578 admin admin] Calling method '>' {{(pid=105759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:14:31.292752 dv-cinder-846303-3-smb devstack@n-api.service[105759]: INFO nova.api.openstack.requestlog [None req-2e854ccd-40f4-451f-9f8f-d01567dd5578 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Aug 27 02:14:31.293135 dv-cinder-846303-3-smb devstack@n-api.service[105759]: [pid: 105759|app: 0|req: 29/59] 10.222.0.61 () {56 vars in 1074 bytes} [Sat Aug 27 02:14:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:14:31.829751 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi [None req-ae110c4f-a71c-4f65-ba03-e4dec6d0409f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:14:31.848847 dv-cinder-846303-3-smb devstack@n-api.service[105760]: INFO nova.api.openstack.requestlog [None req-ae110c4f-a71c-4f65-ba03-e4dec6d0409f admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.421386 Aug 27 02:14:31.849439 dv-cinder-846303-3-smb devstack@n-api.service[105760]: [pid: 105760|app: 0|req: 31/60] 10.222.0.61 () {64 vars in 1235 bytes} [Sat Aug 27 02:14:31 2022] POST /compute/v2.1/flavors => generated 409 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:14:32.815626 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi [None req-2e854ccd-40f4-451f-9f8f-d01567dd5578 admin admin] Calling method '>' {{(pid=105759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:14:32.816654 dv-cinder-846303-3-smb devstack@n-api.service[105759]: INFO nova.api.openstack.requestlog [None req-2e854ccd-40f4-451f-9f8f-d01567dd5578 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Aug 27 02:14:32.817049 dv-cinder-846303-3-smb devstack@n-api.service[105759]: [pid: 105759|app: 0|req: 30/61] 10.222.0.61 () {56 vars in 1074 bytes} [Sat Aug 27 02:14:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:14:33.357159 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi [None req-baccc404-a6da-48cf-9f67-f3b5ee82d551 admin admin] Calling method '>' {{(pid=105760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:14:33.378630 dv-cinder-846303-3-smb devstack@n-api.service[105760]: INFO nova.api.openstack.requestlog [None req-baccc404-a6da-48cf-9f67-f3b5ee82d551 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.424227 Aug 27 02:14:33.379163 dv-cinder-846303-3-smb devstack@n-api.service[105760]: [pid: 105760|app: 0|req: 32/62] 10.222.0.61 () {60 vars in 1202 bytes} [Sat Aug 27 02:14:32 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:15:27.406970 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi [None req-2e854ccd-40f4-451f-9f8f-d01567dd5578 admin admin] Calling method '>' {{(pid=105759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:15:27.407991 dv-cinder-846303-3-smb devstack@n-api.service[105759]: INFO nova.api.openstack.requestlog [None req-2e854ccd-40f4-451f-9f8f-d01567dd5578 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Aug 27 02:15:27.408400 dv-cinder-846303-3-smb devstack@n-api.service[105759]: [pid: 105759|app: 0|req: 31/63] 10.222.0.61 () {54 vars in 931 bytes} [Sat Aug 27 02:15:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:15:27.415998 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG dbcounter [-] [105760] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=105760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:15:27.824969 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi [None req-5d97d230-9286-4c99-a49f-3611b18a7a9f admin admin] Calling method '>' {{(pid=105760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:15:27.846221 dv-cinder-846303-3-smb devstack@n-api.service[105760]: INFO nova.api.openstack.requestlog [None req-5d97d230-9286-4c99-a49f-3611b18a7a9f admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.430944 Aug 27 02:15:27.846675 dv-cinder-846303-3-smb devstack@n-api.service[105760]: [pid: 105760|app: 0|req: 33/64] 10.222.0.61 () {60 vars in 1292 bytes} [Sat Aug 27 02:15:27 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:15:27.868132 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG dbcounter [-] [105759] Writing DB stats nova_api:SELECT=14 {{(pid=105759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:15:27.872076 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi [None req-1bed6210-047d-4fd5-960f-1536d684e6b8 admin admin] Calling method '>' {{(pid=105759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:15:27.881149 dv-cinder-846303-3-smb devstack@n-api.service[105759]: INFO nova.api.openstack.requestlog [None req-1bed6210-047d-4fd5-960f-1536d684e6b8 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014360 Aug 27 02:15:27.881726 dv-cinder-846303-3-smb devstack@n-api.service[105759]: [pid: 105759|app: 0|req: 32/65] 10.222.0.61 () {60 vars in 1283 bytes} [Sat Aug 27 02:15:27 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:15:27.896554 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi [None req-4b90b7d1-01f3-4fb7-8796-ed4c65e70b4d admin admin] Calling method '>' {{(pid=105760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:15:27.904995 dv-cinder-846303-3-smb devstack@n-api.service[105760]: INFO nova.api.openstack.requestlog [None req-4b90b7d1-01f3-4fb7-8796-ed4c65e70b4d admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012392 Aug 27 02:15:27.905492 dv-cinder-846303-3-smb devstack@n-api.service[105760]: [pid: 105760|app: 0|req: 34/66] 10.222.0.61 () {60 vars in 1286 bytes} [Sat Aug 27 02:15:27 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:15:27.917666 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi [None req-01282d10-7cfd-476c-a916-e6565cac4a11 admin admin] Calling method '>' {{(pid=105759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:15:27.925690 dv-cinder-846303-3-smb devstack@n-api.service[105759]: INFO nova.api.openstack.requestlog [None req-01282d10-7cfd-476c-a916-e6565cac4a11 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011712 Aug 27 02:15:27.926322 dv-cinder-846303-3-smb devstack@n-api.service[105759]: [pid: 105759|app: 0|req: 33/67] 10.222.0.61 () {60 vars in 1286 bytes} [Sat Aug 27 02:15:27 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:15:27.938503 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi [None req-2ef69766-09eb-44c6-97a4-bae4208ac93e admin admin] Calling method '>' {{(pid=105760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:15:27.946459 dv-cinder-846303-3-smb devstack@n-api.service[105760]: INFO nova.api.openstack.requestlog [None req-2ef69766-09eb-44c6-97a4-bae4208ac93e admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011640 Aug 27 02:15:27.947004 dv-cinder-846303-3-smb devstack@n-api.service[105760]: [pid: 105760|app: 0|req: 35/68] 10.222.0.61 () {60 vars in 1283 bytes} [Sat Aug 27 02:15:27 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:18:40.516781 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi [None req-01282d10-7cfd-476c-a916-e6565cac4a11 admin admin] Calling method '>' {{(pid=105759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:18:40.517845 dv-cinder-846303-3-smb devstack@n-api.service[105759]: INFO nova.api.openstack.requestlog [None req-01282d10-7cfd-476c-a916-e6565cac4a11 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Aug 27 02:18:40.518237 dv-cinder-846303-3-smb devstack@n-api.service[105759]: [pid: 105759|app: 0|req: 34/69] 10.222.0.61 () {56 vars in 1074 bytes} [Sat Aug 27 02:18:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:18:40.656487 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG dbcounter [-] [105760] Writing DB stats nova_api:SELECT=6 {{(pid=105760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:18:40.821887 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi [None req-f5907b92-2d18-4452-8319-554f2d578cb8 admin admin] Calling method '>' {{(pid=105760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:18:40.825489 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG oslo_concurrency.lockutils [None req-f5907b92-2d18-4452-8319-554f2d578cb8 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:18:40.825961 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG oslo_concurrency.lockutils [None req-f5907b92-2d18-4452-8319-554f2d578cb8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:18:40.826386 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG oslo_concurrency.lockutils [None req-f5907b92-2d18-4452-8319-554f2d578cb8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:18:40.827094 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG oslo_concurrency.lockutils [None req-f5907b92-2d18-4452-8319-554f2d578cb8 admin admin] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:18:40.827563 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG oslo_concurrency.lockutils [None req-f5907b92-2d18-4452-8319-554f2d578cb8 admin admin] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:18:40.828163 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG oslo_concurrency.lockutils [None req-f5907b92-2d18-4452-8319-554f2d578cb8 admin admin] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:18:40.861697 dv-cinder-846303-3-smb devstack@n-api.service[105760]: INFO nova.api.openstack.requestlog [None req-f5907b92-2d18-4452-8319-554f2d578cb8 admin admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 785 microversion: 2.90 time: 0.206512 Aug 27 02:18:40.862260 dv-cinder-846303-3-smb devstack@n-api.service[105760]: [pid: 105760|app: 0|req: 36/70] 10.222.0.61 () {60 vars in 1193 bytes} [Sat Aug 27 02:18:40 2022] GET /compute/v2.1/os-services => generated 785 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:18:41.681962 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi [None req-01282d10-7cfd-476c-a916-e6565cac4a11 admin admin] Calling method '>' {{(pid=105759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:18:41.682996 dv-cinder-846303-3-smb devstack@n-api.service[105759]: INFO nova.api.openstack.requestlog [None req-01282d10-7cfd-476c-a916-e6565cac4a11 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001550 Aug 27 02:18:41.683394 dv-cinder-846303-3-smb devstack@n-api.service[105759]: [pid: 105759|app: 0|req: 35/71] 10.222.0.61 () {56 vars in 1074 bytes} [Sat Aug 27 02:18:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:18:41.882081 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi [None req-8c38cd23-838a-4329-ba80-7499b36997b3 admin admin] Calling method '>' {{(pid=105760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:18:41.886040 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG oslo_concurrency.lockutils [None req-8c38cd23-838a-4329-ba80-7499b36997b3 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:18:41.886454 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG oslo_concurrency.lockutils [None req-8c38cd23-838a-4329-ba80-7499b36997b3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:18:41.886952 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG oslo_concurrency.lockutils [None req-8c38cd23-838a-4329-ba80-7499b36997b3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:18:41.887836 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG oslo_concurrency.lockutils [None req-8c38cd23-838a-4329-ba80-7499b36997b3 admin admin] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:18:41.888279 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG oslo_concurrency.lockutils [None req-8c38cd23-838a-4329-ba80-7499b36997b3 admin admin] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:18:41.888810 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG oslo_concurrency.lockutils [None req-8c38cd23-838a-4329-ba80-7499b36997b3 admin admin] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:18:41.909075 dv-cinder-846303-3-smb devstack@n-api.service[105760]: INFO nova.api.openstack.requestlog [None req-8c38cd23-838a-4329-ba80-7499b36997b3 admin admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 785 microversion: 2.90 time: 0.083414 Aug 27 02:18:41.909737 dv-cinder-846303-3-smb devstack@n-api.service[105760]: [pid: 105760|app: 0|req: 37/72] 10.222.0.61 () {60 vars in 1193 bytes} [Sat Aug 27 02:18:41 2022] GET /compute/v2.1/os-services => generated 785 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:18:53.186303 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi [None req-01282d10-7cfd-476c-a916-e6565cac4a11 admin admin] Calling method '>' {{(pid=105759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:18:53.187311 dv-cinder-846303-3-smb devstack@n-api.service[105759]: INFO nova.api.openstack.requestlog [None req-01282d10-7cfd-476c-a916-e6565cac4a11 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Aug 27 02:18:53.187692 dv-cinder-846303-3-smb devstack@n-api.service[105759]: [pid: 105759|app: 0|req: 36/73] 10.222.0.61 () {56 vars in 1074 bytes} [Sat Aug 27 02:18:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:18:53.331585 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG dbcounter [-] [105760] Writing DB stats nova_cell0:SELECT=4 {{(pid=105760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:18:53.332311 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG dbcounter [-] [105760] Writing DB stats nova_cell1:SELECT=4 {{(pid=105760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:18:53.332937 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG dbcounter [-] [105760] Writing DB stats nova_api:SELECT=8 {{(pid=105760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:18:53.383865 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi [None req-f2fdc48c-d187-4dd0-9e9e-c7839fb22f58 admin admin] Calling method '>' {{(pid=105760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:18:53.387342 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG oslo_concurrency.lockutils [None req-f2fdc48c-d187-4dd0-9e9e-c7839fb22f58 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:18:53.387746 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG oslo_concurrency.lockutils [None req-f2fdc48c-d187-4dd0-9e9e-c7839fb22f58 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:18:53.388190 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG oslo_concurrency.lockutils [None req-f2fdc48c-d187-4dd0-9e9e-c7839fb22f58 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:18:53.388925 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG oslo_concurrency.lockutils [None req-f2fdc48c-d187-4dd0-9e9e-c7839fb22f58 admin admin] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:18:53.389359 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG oslo_concurrency.lockutils [None req-f2fdc48c-d187-4dd0-9e9e-c7839fb22f58 admin admin] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:18:53.389796 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG oslo_concurrency.lockutils [None req-f2fdc48c-d187-4dd0-9e9e-c7839fb22f58 admin admin] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:18:53.414711 dv-cinder-846303-3-smb devstack@n-api.service[105760]: INFO nova.api.openstack.requestlog [None req-f2fdc48c-d187-4dd0-9e9e-c7839fb22f58 admin admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 1005 microversion: 2.90 time: 0.091166 Aug 27 02:18:53.415273 dv-cinder-846303-3-smb devstack@n-api.service[105760]: [pid: 105760|app: 0|req: 38/74] 10.222.0.61 () {60 vars in 1193 bytes} [Sat Aug 27 02:18:53 2022] GET /compute/v2.1/os-services => generated 1005 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:18:54.229052 dv-cinder-846303-3-smb devstack@n-api.service[105759]: DEBUG nova.api.openstack.wsgi [None req-01282d10-7cfd-476c-a916-e6565cac4a11 admin admin] Calling method '>' {{(pid=105759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:18:54.230085 dv-cinder-846303-3-smb devstack@n-api.service[105759]: INFO nova.api.openstack.requestlog [None req-01282d10-7cfd-476c-a916-e6565cac4a11 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Aug 27 02:18:54.230476 dv-cinder-846303-3-smb devstack@n-api.service[105759]: [pid: 105759|app: 0|req: 37/75] 10.222.0.61 () {56 vars in 1074 bytes} [Sat Aug 27 02:18:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:18:54.424464 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG nova.api.openstack.wsgi [None req-15f619f0-10f3-4484-8eff-05d383318c10 admin admin] Calling method '>' {{(pid=105760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:18:54.427941 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG oslo_concurrency.lockutils [None req-15f619f0-10f3-4484-8eff-05d383318c10 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:18:54.428444 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG oslo_concurrency.lockutils [None req-15f619f0-10f3-4484-8eff-05d383318c10 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:18:54.428869 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG oslo_concurrency.lockutils [None req-15f619f0-10f3-4484-8eff-05d383318c10 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:18:54.429629 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG oslo_concurrency.lockutils [None req-15f619f0-10f3-4484-8eff-05d383318c10 admin admin] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:18:54.430079 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG oslo_concurrency.lockutils [None req-15f619f0-10f3-4484-8eff-05d383318c10 admin admin] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:18:54.430755 dv-cinder-846303-3-smb devstack@n-api.service[105760]: DEBUG oslo_concurrency.lockutils [None req-15f619f0-10f3-4484-8eff-05d383318c10 admin admin] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:18:54.455561 dv-cinder-846303-3-smb devstack@n-api.service[105760]: INFO nova.api.openstack.requestlog [None req-15f619f0-10f3-4484-8eff-05d383318c10 admin admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 1005 microversion: 2.90 time: 0.085781 Aug 27 02:18:54.456172 dv-cinder-846303-3-smb devstack@n-api.service[105760]: [pid: 105760|app: 0|req: 39/76] 10.222.0.61 () {60 vars in 1193 bytes} [Sat Aug 27 02:18:54 2022] GET /compute/v2.1/os-services => generated 1005 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:19:53.486736 dv-cinder-846303-3-smb devstack@n-api.service[105758]: Sat Aug 27 02:19:53 2022 - graceful shutdown triggered... Aug 27 02:19:53.486819 dv-cinder-846303-3-smb systemd[1]: Stopping Devstack devstack@n-api.service... Aug 27 02:19:53.487702 dv-cinder-846303-3-smb devstack@n-api.service[105759]: Gracefully killing worker 1 (pid: 105759)... Aug 27 02:19:53.488678 dv-cinder-846303-3-smb devstack@n-api.service[105760]: Gracefully killing worker 2 (pid: 105760)... Aug 27 02:19:54.488727 dv-cinder-846303-3-smb devstack@n-api.service[105758]: worker 1 buried after 1 seconds Aug 27 02:19:54.488727 dv-cinder-846303-3-smb devstack@n-api.service[105758]: worker 2 buried after 1 seconds Aug 27 02:19:54.488727 dv-cinder-846303-3-smb devstack@n-api.service[105758]: goodbye to uWSGI. Aug 27 02:19:54.490830 dv-cinder-846303-3-smb systemd[1]: devstack@n-api.service: Succeeded. Aug 27 02:19:54.491411 dv-cinder-846303-3-smb systemd[1]: Stopped Devstack devstack@n-api.service. Aug 27 02:19:54.494281 dv-cinder-846303-3-smb systemd[1]: Starting Devstack devstack@n-api.service... Aug 27 02:19:54.506399 dv-cinder-846303-3-smb devstack@n-api.service[120748]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 27 02:19:54.508650 dv-cinder-846303-3-smb devstack@n-api.service[120748]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Aug 27 02:19:54 2022] *** Aug 27 02:19:54.508650 dv-cinder-846303-3-smb devstack@n-api.service[120748]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 27 02:19:54.508650 dv-cinder-846303-3-smb devstack@n-api.service[120748]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 27 02:19:54.508650 dv-cinder-846303-3-smb devstack@n-api.service[120748]: nodename: dv-cinder-846303-3-smb Aug 27 02:19:54.508650 dv-cinder-846303-3-smb devstack@n-api.service[120748]: machine: x86_64 Aug 27 02:19:54.508650 dv-cinder-846303-3-smb devstack@n-api.service[120748]: clock source: unix Aug 27 02:19:54.508650 dv-cinder-846303-3-smb devstack@n-api.service[120748]: pcre jit disabled Aug 27 02:19:54.508650 dv-cinder-846303-3-smb devstack@n-api.service[120748]: detected number of CPU cores: 4 Aug 27 02:19:54.508650 dv-cinder-846303-3-smb devstack@n-api.service[120748]: current working directory: / Aug 27 02:19:54.508650 dv-cinder-846303-3-smb devstack@n-api.service[120748]: detected binary path: /usr/bin/uwsgi-core Aug 27 02:19:54.509324 dv-cinder-846303-3-smb devstack@n-api.service[120748]: your processes number limit is 47680 Aug 27 02:19:54.509324 dv-cinder-846303-3-smb devstack@n-api.service[120748]: your memory page size is 4096 bytes Aug 27 02:19:54.509324 dv-cinder-846303-3-smb devstack@n-api.service[120748]: detected max file descriptor number: 2048 Aug 27 02:19:54.509324 dv-cinder-846303-3-smb devstack@n-api.service[120748]: lock engine: pthread robust mutexes Aug 27 02:19:54.509324 dv-cinder-846303-3-smb devstack@n-api.service[120748]: thunder lock: enabled Aug 27 02:19:54.509324 dv-cinder-846303-3-smb devstack@n-api.service[120748]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 27 02:19:54.509324 dv-cinder-846303-3-smb devstack@n-api.service[120748]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 27 02:19:54.555071 dv-cinder-846303-3-smb devstack@n-api.service[120748]: Python main interpreter initialized at 0x55b7ea4359c0 Aug 27 02:19:54.555071 dv-cinder-846303-3-smb devstack@n-api.service[120748]: python threads support enabled Aug 27 02:19:54.555071 dv-cinder-846303-3-smb devstack@n-api.service[120748]: your server socket listen backlog is limited to 100 connections Aug 27 02:19:54.555071 dv-cinder-846303-3-smb devstack@n-api.service[120748]: your mercy for graceful operations on workers is 90 seconds Aug 27 02:19:54.555513 dv-cinder-846303-3-smb devstack@n-api.service[120748]: mapped 403077 bytes (393 KB) for 2 cores Aug 27 02:19:54.555513 dv-cinder-846303-3-smb devstack@n-api.service[120748]: *** Operational MODE: preforking *** Aug 27 02:19:54.555809 dv-cinder-846303-3-smb devstack@n-api.service[120748]: *** uWSGI is running in multiple interpreter mode *** Aug 27 02:19:54.555809 dv-cinder-846303-3-smb devstack@n-api.service[120748]: spawned uWSGI master process (pid: 120748) Aug 27 02:19:54.556017 dv-cinder-846303-3-smb systemd[1]: Started Devstack devstack@n-api.service. Aug 27 02:19:54.558585 dv-cinder-846303-3-smb devstack@n-api.service[120748]: spawned uWSGI worker 1 (pid: 120782, cores: 1) Aug 27 02:19:54.558585 dv-cinder-846303-3-smb devstack@n-api.service[120748]: spawned uWSGI worker 2 (pid: 120783, cores: 1) Aug 27 02:19:54.558585 dv-cinder-846303-3-smb devstack@n-api.service[120748]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 27 02:19:55.217362 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 27 02:19:55.222220 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 27 02:19:56.364082 dv-cinder-846303-3-smb devstack@n-api.service[120782]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 02:19:56.364082 dv-cinder-846303-3-smb devstack@n-api.service[120782]: from cryptography.utils import int_from_bytes Aug 27 02:19:56.364742 dv-cinder-846303-3-smb devstack@n-api.service[120782]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 02:19:56.364742 dv-cinder-846303-3-smb devstack@n-api.service[120782]: from cryptography.utils import int_from_bytes Aug 27 02:19:56.382558 dv-cinder-846303-3-smb devstack@n-api.service[120783]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 02:19:56.382558 dv-cinder-846303-3-smb devstack@n-api.service[120783]: from cryptography.utils import int_from_bytes Aug 27 02:19:56.383166 dv-cinder-846303-3-smb devstack@n-api.service[120783]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 02:19:56.383166 dv-cinder-846303-3-smb devstack@n-api.service[120783]: from cryptography.utils import int_from_bytes Aug 27 02:19:58.777554 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 27 02:19:58.778280 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 27 02:19:58.778373 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 27 02:19:58.778698 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 27 02:19:58.778952 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 27 02:19:58.779341 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.780498 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.780498 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.780498 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.780740 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.781059 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.781385 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.781731 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.782034 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.782295 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.782668 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.782986 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846303-3-smb {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.783310 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.783620 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.783928 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.784250 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.784554 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.784863 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.785193 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.785817 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.786283 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.786603 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.786853 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.787217 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.787495 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.787999 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.788310 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.788671 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.788922 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.789229 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.789664 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846303-3-smb {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.789984 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.790299 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.790611 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.791039 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.791349 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.791656 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.791974 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.792321 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.792599 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.792927 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.793245 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.793600 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.793923 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.794226 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.794532 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.794840 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.795160 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.795473 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.795777 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.796025 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.796331 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.796649 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.796967 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.797288 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.797566 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.797819 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.798201 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.798521 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.798851 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.799131 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.799472 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.799742 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.800045 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.800349 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.800821 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.801123 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.801463 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.801780 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.802102 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.802410 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.802728 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.803136 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.61 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.803384 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.61 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.803689 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.804029 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.804345 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.804653 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.804971 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.805289 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.805626 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.805954 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.806244 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.806563 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.806898 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.807203 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.807452 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.807755 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.808097 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.808412 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.808716 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.809017 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.809321 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.809782 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.809919 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.810238 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.810515 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.810829 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.811147 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.811520 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.811712 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.812049 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.812321 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.812640 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.812957 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.813264 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.813590 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.813954 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.814261 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.814580 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.814886 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.815194 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.815517 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.815825 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.816135 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.816451 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.816757 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.817058 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.817375 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.817699 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.818006 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.818323 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.818626 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.818930 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.819231 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.819533 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.819835 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.820139 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.820439 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.820739 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.821037 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.821354 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.821768 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.822079 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.822383 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.822686 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.823003 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.823344 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.823670 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.824014 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.824327 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.824659 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.824989 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.825145 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 27 02:19:58.825838 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.825998 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 27 02:19:58.826174 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.826174 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.826484 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 27 02:19:58.826641 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.826821 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 27 02:19:58.826970 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.827122 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 27 02:19:58.827304 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.827686 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.827851 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.827851 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.828164 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.829492 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.829666 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.829666 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.829856 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.829943 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.830034 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.830127 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.830222 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.830317 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.830410 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.830503 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.830606 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.830606 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.830769 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.830769 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.830941 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.831034 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.831128 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.831128 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.831305 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846303-3-smb {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.831403 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.831495 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.831587 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.831679 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.831774 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.831860 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.831955 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.832036 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.832274 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.832481 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.832586 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.832790 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.832946 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.833108 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.833212 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.833374 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.834707 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.834890 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.834989 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.835087 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.835172 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.835256 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.835345 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.835439 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.835536 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.835536 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.835674 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.835764 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.835850 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.835941 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.836026 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.836310 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.836450 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.836625 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.836778 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.836954 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.837105 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.837225 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.837324 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.837570 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.837710 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846303-3-smb {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.837922 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.838075 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.838209 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.838310 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.838532 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.838642 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.838861 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.839015 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.839150 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.839254 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.839479 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.839737 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.839877 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.840057 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.840211 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.840313 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.840416 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.840649 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.840789 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.840962 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.841103 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.841242 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.841352 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.841591 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.841706 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.841915 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.842053 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.842168 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.842264 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.842498 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.842638 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.842775 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.842887 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.843099 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.843197 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.843397 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.843493 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.843697 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.843793 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.843942 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.844046 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.844244 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.844341 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.844560 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.844668 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.844874 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.845015 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.845254 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.845350 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.845519 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.845626 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.845779 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.845884 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.846093 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.846189 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.846419 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.846515 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.846721 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.846823 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.847024 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.847127 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.847328 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.847432 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.847631 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.847764 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.848043 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.848148 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.848251 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.848338 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.848505 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.848624 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.848807 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.848925 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.849124 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.849224 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.849499 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.849599 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.849802 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.849912 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.850098 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.850222 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.850413 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.850534 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.850726 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.850835 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.61 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.851031 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.851140 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.61 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.851329 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.851431 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.851630 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.851739 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.851936 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.852033 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.852242 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.852338 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.852548 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.852645 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.852850 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.852947 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.853146 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.853247 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.853466 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.853561 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.853769 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.853864 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.854069 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.854172 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.854388 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.854494 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.854686 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.854790 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.854987 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.855082 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.855296 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.855405 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.855597 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.855700 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.855936 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.856041 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.856242 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.856351 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.856582 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.856678 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.856916 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.857012 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.857235 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.857349 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.857589 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.857696 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.857934 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.858034 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.858205 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.858311 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.858574 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.858683 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.858821 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.858956 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.859142 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.859447 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.859558 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.859753 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.859849 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.860055 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.860239 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.860386 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.860479 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.860786 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.860894 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.861095 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.861205 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.861426 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.861523 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.861726 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.861833 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.862032 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.862134 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.862359 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.862510 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.862671 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.862817 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.863015 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.863112 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.863349 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.863445 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.863666 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.863762 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.863969 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.864071 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.864283 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.864397 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.864585 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.864687 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.864886 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.865055 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.865207 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.865363 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.865535 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.865677 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.865819 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.865961 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.866113 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.866265 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.866408 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.866549 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.866698 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.866842 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.866993 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.867145 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.867295 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.867439 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.867595 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.867738 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.867889 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.868821 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.868977 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.869641 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.869797 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.869939 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.870097 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.870253 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.870405 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.870556 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.870708 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.870852 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.871004 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.871148 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.871289 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.871440 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.871591 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.871742 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.871895 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:19:58.872057 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.872209 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.872359 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.872502 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.872654 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.872805 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.872955 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.873098 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.873248 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.873416 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.873619 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.873775 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.873919 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.874085 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.874240 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.874383 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.874555 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.874701 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.874844 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.874986 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.875139 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.875281 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.875436 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.875587 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.875731 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.875892 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.876049 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.876240 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.876398 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.876548 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.876691 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.876835 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.876985 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.877137 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.877279 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.877471 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.877628 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.877779 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.877935 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.877935 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.878339 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.878488 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.878677 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.878881 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.879043 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.879220 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.879866 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.880027 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.880171 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.880322 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.880479 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.880633 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.880777 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.880920 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.881063 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.881205 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.881357 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.881535 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.881680 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.881821 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.881962 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.882112 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.882268 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.882422 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.882583 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.882733 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.882876 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.883017 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.883170 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.883313 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.883455 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.883604 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.883761 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.883931 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.884081 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.884229 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.884388 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.884557 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.884706 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.884864 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.885031 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.885183 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.885332 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.885527 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.885685 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.885850 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.886008 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.886164 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.886463 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.886643 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.886795 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.886952 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.887103 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.887260 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.887411 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.887411 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.887703 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.887861 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.888017 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.888168 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.888337 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.888565 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.888744 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.888948 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.889100 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.889257 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.889430 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.889830 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.890285 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.890441 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.890597 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.890762 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.890925 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.891075 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.891223 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.891384 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.891534 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.891761 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.891953 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.892104 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.892254 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.892409 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.892560 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.892719 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.892868 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.893017 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.893165 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.893728 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.893897 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.894065 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.894215 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.894364 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.894529 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.894689 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.894846 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.895009 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.895159 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.895307 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.895463 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.895620 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.895796 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.895947 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.895947 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.896238 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.896389 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.896537 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.896697 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.896862 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.897013 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.897168 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.897325 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.897498 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.897668 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.897829 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.897986 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.898135 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.898292 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.898457 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.898715 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.898881 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.899082 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.899236 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.899385 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.899547 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.899931 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.900284 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.900461 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.900620 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.900770 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.900933 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.901089 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.901250 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.901455 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.901611 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.901768 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.901929 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.902087 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.902237 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.902404 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.902554 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.902716 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.902873 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.903023 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.903179 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.903329 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.903477 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.903640 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.903789 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.903947 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.904098 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.904246 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.904418 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.904585 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.904743 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.904893 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.905049 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.905212 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.905370 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.905685 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.905863 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.906015 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.906172 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.906321 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.906483 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.906652 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.906802 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.906951 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.907099 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.907257 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.907479 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.907662 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.907890 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.908074 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.908227 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.908385 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.908544 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.908720 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.908964 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.909160 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.909321 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.909527 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.909692 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.910120 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.910484 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.910642 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.910791 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.910791 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.911102 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.911251 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.911400 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.911578 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.911738 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.911904 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.912063 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.912213 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.912369 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.912520 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.912520 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.912821 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.912821 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.913114 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.913271 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.913452 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.913608 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.913774 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.913924 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.914080 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.914238 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.914394 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.914557 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.914707 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.914873 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.915023 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.915173 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.915321 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.915489 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.915648 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.915805 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.915963 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.916121 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.916280 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.916487 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.916639 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.916796 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.916955 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.916955 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.917239 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.917422 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.917590 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.917741 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.917890 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.918039 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.918205 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.918362 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.918562 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.918721 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.918872 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.919182 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.919350 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.919502 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.919660 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.919831 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.920155 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.920401 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.920752 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.920910 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.921060 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.921209 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.921366 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.921583 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.921752 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.921905 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.922054 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.922203 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.922372 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.922537 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.922687 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.922843 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.923038 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.923194 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.923344 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.923504 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.923654 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.923818 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.924000 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.924162 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.924323 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.924568 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.924722 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.924887 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.925047 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.925198 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.925524 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.925700 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.925851 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.926000 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.926151 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.926315 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.926474 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.926645 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.926804 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.926963 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.927121 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.927272 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.927437 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.927597 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.927747 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.927904 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.928062 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.928222 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.928381 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.928569 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.928743 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.928901 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.929059 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.929345 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.929544 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.929696 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.929852 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.930009 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.930319 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.930571 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.930931 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.931099 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.931259 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.931421 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.931579 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.931743 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.931903 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.932053 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.932212 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.932372 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.932523 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.932755 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.932909 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.933058 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.933207 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.933369 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.933568 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.933731 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.933882 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.934047 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.934047 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.934347 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.934501 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.934660 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.934810 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.934959 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.935107 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.935255 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.935423 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.935582 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.935858 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.936017 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.936174 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.936325 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.936488 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.936647 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.936806 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.936956 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.937121 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.937271 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.937456 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.937638 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.937797 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.937955 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.937955 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.938249 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.938414 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.938564 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.938779 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.938940 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.939098 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.939401 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.939562 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.939714 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.939883 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.940035 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.940193 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.940571 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.940571 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.941218 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.941374 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.941549 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.941700 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.941864 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.942014 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.942164 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.942325 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.942474 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.942624 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.942786 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.942948 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.943107 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.943266 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.943426 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.943586 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.943744 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.943894 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.944043 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.944207 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.944377 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.944530 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.944680 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.944829 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.944987 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.945146 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.945303 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.945535 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.945700 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.945859 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.946026 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.946177 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.946326 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.946487 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.946645 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.946797 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.946961 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.947121 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.947280 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.947438 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.947589 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.947746 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.947909 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.948070 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.948228 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.948386 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.948555 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.948712 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.948882 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.949042 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.949194 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.949345 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.949706 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.949867 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.950018 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.950183 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.950341 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.950708 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.951001 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.951463 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.951622 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.951780 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.951931 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.952088 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.952252 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.952416 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.952576 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.952728 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.952878 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.953027 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.953184 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.953356 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.953592 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.953755 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.953914 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.954072 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.954265 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.954428 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.954586 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.954736 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.954893 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.955043 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.955207 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.955366 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.955529 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.955678 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.955678 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.955971 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.955971 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.956265 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.956429 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.956581 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.956581 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.956872 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.957030 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.957188 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.957348 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.957520 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.957670 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.957832 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.957983 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.958141 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.958292 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.958441 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.958590 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.958590 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.958884 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.959041 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.959192 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.959357 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.959572 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.959831 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.959987 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.960136 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.960285 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.960285 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.960596 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.960916 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.961169 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.961352 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.961701 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.961865 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.962039 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.962191 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.962349 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.962500 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.962649 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.962799 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.963023 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.963184 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.963342 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.963502 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.963652 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.963811 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.963976 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.964137 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.964294 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.964468 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.964627 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.964786 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.964946 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.965104 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.965263 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.965458 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.965624 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.965785 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.965936 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.966107 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.966264 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.966414 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.966571 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.966739 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.966889 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.967046 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.967196 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.967354 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.967503 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.967666 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.967817 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.967966 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.968125 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.968283 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.968433 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.968597 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.968756 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.968906 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.969064 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.969221 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.969385 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.969605 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.969761 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.970067 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.970232 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.970393 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.970568 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.970729 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.971038 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.971221 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.971450 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.971641 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.971986 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.972143 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.972294 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.972453 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.972453 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.972757 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.972928 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.973088 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.973239 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.973439 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.973617 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.973776 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.973927 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.974075 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.974232 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.974398 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.974566 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.974717 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.974873 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.975042 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.975200 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.975360 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.975511 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.975511 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.975802 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.975952 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.976110 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.976269 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.976420 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.976570 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.976720 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.976882 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.977040 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.977199 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.977350 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.977524 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.977674 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.977824 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.977974 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.978140 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.978300 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.978450 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.979346 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.979346 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.979728 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.979884 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.980059 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.980306 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.980462 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.980799 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.981287 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.981480 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.981727 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.981908 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.982250 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.982406 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.982593 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.982746 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.982897 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.983047 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.983208 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.983368 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.983527 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.983687 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.983848 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.984007 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.984166 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.984333 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.984498 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.984656 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.984808 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.984967 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.985118 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.985278 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.985524 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.985683 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.985834 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.985995 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.986160 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.986328 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.986480 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.986646 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.986797 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.986797 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.987167 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.987328 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.987479 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.987637 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.987788 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.987946 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.988105 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.988264 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.988423 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.988423 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.988720 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.988884 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.989043 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.989193 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.989350 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.989350 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.989677 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.989883 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.990045 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.990240 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.990492 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.990648 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.990810 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.990974 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.991126 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.991442 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.991598 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.991841 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.992005 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.992184 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.992513 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.992669 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.992833 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.993000 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.993162 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.993333 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.993552 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.993704 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.993853 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.994009 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.994169 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.994335 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.994496 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.994657 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.994808 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.994964 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.995129 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.995304 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.995455 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.995625 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.995790 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.995948 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.995948 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.996255 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.996408 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.996558 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.996707 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.996866 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.997023 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.997174 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.997342 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.997515 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.997677 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.997837 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.997988 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.998144 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.998294 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.998444 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.998593 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.998756 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.998907 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.999056 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.999205 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.999372 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.999530 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.999690 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:58.999841 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.000046 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.000213 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.000371 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.000621 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.000777 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.000936 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.002040 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.002454 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.002829 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.003006 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.003166 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.003363 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.003541 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.003702 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.003864 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.004014 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.004163 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.004313 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.004470 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.004470 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.004809 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.004961 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.005111 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.005260 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.005474 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.005657 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.005811 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.005967 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.006124 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.006280 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.006439 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.006604 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.006752 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.006865 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.006977 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.007117 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.007247 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.007430 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.007594 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.007753 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.007962 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.008259 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.008940 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.009068 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.009259 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.009259 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.009537 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.009689 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.009837 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.010060 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.010195 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.010195 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.010435 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.010589 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.010829 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.010829 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.011097 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.011225 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.011353 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.011491 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.011610 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.011610 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.012209 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.012209 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.012450 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.012633 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.013071 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.013205 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.013345 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.013576 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.013716 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.013843 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.013843 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.014102 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.014240 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.014367 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.014513 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.014653 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.014780 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.014915 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.015043 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.015171 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.015312 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.015440 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.015568 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.015696 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.015831 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.015966 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.016108 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.016240 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.016240 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.016487 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.016616 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.016782 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.016920 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.016920 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.017161 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.017296 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.017439 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.017439 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.017439 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.017439 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.017439 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.018049 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.018183 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.018714 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.018714 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.018970 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.019130 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.019130 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.019130 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.019130 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.019130 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.019130 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.019130 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.019966 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.020178 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.020178 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.020440 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.020568 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.020568 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.020831 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.021073 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.021073 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.021360 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.021556 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.021556 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.021810 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.022138 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.022138 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.022539 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.022667 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.022803 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.022956 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.022956 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.022956 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.023536 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.023674 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.023674 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.023923 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.024058 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.024185 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.024312 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.024312 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.024618 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.024760 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.024760 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.025001 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.025135 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.025271 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.025432 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.025614 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.025745 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.025880 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.026007 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.026007 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.026263 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.026598 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.026890 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.027386 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.027386 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.027655 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.027788 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.027924 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.028052 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.028052 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.028292 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.028408 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.028408 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.028783 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.028959 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.028959 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.028959 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.029493 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.029625 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.029754 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.029890 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.030016 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.030187 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.030187 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.030187 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.030548 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.031005 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.031005 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.031460 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.031627 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.031627 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.031913 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.032058 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.032627 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.032790 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.032936 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.033067 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.033067 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.033572 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.033720 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.033720 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.033979 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.033979 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.034205 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.034379 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.034519 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.034519 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.034834 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.034970 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.035139 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.035327 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.035493 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.035909 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.036307 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.036444 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.036709 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.036839 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.037046 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.037223 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.037353 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.037725 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.037866 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.038046 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.038224 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.038364 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.038671 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.038841 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.039002 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.039163 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.039315 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.039614 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.039744 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.039948 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.040100 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.040289 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.040533 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.040663 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.040890 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.041333 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.041638 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.041805 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.041944 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.042072 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.042270 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.042729 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.042903 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.043228 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.043362 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.043630 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.043860 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.043991 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.044178 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.044356 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.044482 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.044801 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.044931 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.045104 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.045526 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.045673 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.045852 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.046049 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.046179 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.046489 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.046640 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.046820 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.046993 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.047318 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.047459 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.047629 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.047982 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.048123 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.048364 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.048525 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.048683 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.048985 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.049116 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.049352 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.049699 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.050025 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.050162 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.050346 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.051066 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.051200 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 27 02:19:59.051297 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.051717 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.052113 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.052747 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.053240 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.053860 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.054258 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.054706 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.055286 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.055795 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.056139 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.056609 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.057054 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.057622 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.058090 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.058408 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.058740 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.059078 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.059392 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.059717 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.060032 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.060694 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.061041 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.061364 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.061722 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.062053 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.062375 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.062686 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.063018 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.063325 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.063690 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.064021 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.064334 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.064643 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.064948 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.065262 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.065601 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.065911 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.066221 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.066526 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.066858 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.067168 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.067475 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.067779 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.068100 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.068391 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.068695 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.069004 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.069915 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.070261 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.070578 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.070894 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.071216 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.071523 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.071833 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.072145 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.072502 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.072836 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.073147 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.073646 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.074073 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.074391 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.074714 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.075031 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.075343 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.075698 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.076017 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.076594 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.076931 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.077251 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.077727 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.078060 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.078372 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.078679 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.078985 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.079367 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.079685 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.079997 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.080308 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.080622 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.080933 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.081241 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.081575 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.081885 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.082196 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.082506 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.082810 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.083118 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.083441 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.083735 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.084056 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.084393 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.084707 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.085010 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.085326 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.085669 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.085975 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.086283 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.086588 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.086893 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.087225 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.087531 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.087902 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.088211 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.088644 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.088954 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.089272 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.089618 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.089927 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.090322 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.090562 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.090872 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.091202 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.091718 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.092045 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.092383 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.092773 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.093117 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.093627 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.094023 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.094416 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.094830 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.095306 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.095702 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.096067 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.096442 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.096820 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.097191 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.097592 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.098004 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.098391 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.098773 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.099139 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.099513 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.099883 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.100248 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.100615 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.100986 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.101357 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.101752 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.102127 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.102479 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.102850 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.103233 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.104060 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.104383 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.104820 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.105020 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.105570 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.105851 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.106309 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.106757 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.107147 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.107536 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.108025 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.108376 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.108831 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.109120 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.109534 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.109891 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.110268 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.110676 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.111067 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.111459 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.111819 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.112209 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.112604 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.112746 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO dbcounter [None req-3cd92c64-4d60-4a43-859a-05244fbe3fdd None None] Registered counter for database nova_api Aug 27 02:19:59.113047 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.113449 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.113820 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.114264 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.114651 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.115167 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.115392 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.115775 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.116150 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.116574 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.116953 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.117365 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.117744 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.118178 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.118578 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.119033 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.119451 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.119884 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.120217 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.120574 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.120918 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.121309 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.122029 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.122352 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.122666 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.122970 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:19:59.123219 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 27 02:19:59.133569 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_db.sqlalchemy.engines [None req-3cd92c64-4d60-4a43-859a-05244fbe3fdd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120783) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 02:19:59.140202 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writer thread running {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 02:19:59.188694 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO dbcounter [None req-3505673b-9aaa-41bc-b39e-f7e68dc278db None None] Registered counter for database nova_api Aug 27 02:19:59.199241 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.context [None req-3cd92c64-4d60-4a43-859a-05244fbe3fdd None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fd1fc341-d010-4ff9-88d0-44b72da91d5f(cell1) {{(pid=120783) load_cells /opt/stack/nova/nova/context.py:464}} Aug 27 02:19:59.203321 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3cd92c64-4d60-4a43-859a-05244fbe3fdd None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:19:59.203802 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3cd92c64-4d60-4a43-859a-05244fbe3fdd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:19:59.205542 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3cd92c64-4d60-4a43-859a-05244fbe3fdd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:19:59.206290 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3cd92c64-4d60-4a43-859a-05244fbe3fdd None None] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:19:59.206755 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3cd92c64-4d60-4a43-859a-05244fbe3fdd None None] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:19:59.208791 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3cd92c64-4d60-4a43-859a-05244fbe3fdd None None] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:19:59.210929 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO dbcounter [None req-3cd92c64-4d60-4a43-859a-05244fbe3fdd None None] Registered counter for database nova_cell0 Aug 27 02:19:59.211106 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_db.sqlalchemy.engines [None req-3505673b-9aaa-41bc-b39e-f7e68dc278db None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120782) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 02:19:59.215060 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO dbcounter [None req-3cd92c64-4d60-4a43-859a-05244fbe3fdd None None] Registered counter for database nova_cell1 Aug 27 02:19:59.219231 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writer thread running {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 02:19:59.222965 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_db.sqlalchemy.engines [None req-3cd92c64-4d60-4a43-859a-05244fbe3fdd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120783) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 02:19:59.223878 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_db.sqlalchemy.engines [None req-3cd92c64-4d60-4a43-859a-05244fbe3fdd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120783) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 02:19:59.231503 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writer thread running {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 02:19:59.233005 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writer thread running {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 02:19:59.276345 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.context [None req-3505673b-9aaa-41bc-b39e-f7e68dc278db None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fd1fc341-d010-4ff9-88d0-44b72da91d5f(cell1) {{(pid=120782) load_cells /opt/stack/nova/nova/context.py:464}} Aug 27 02:19:59.280408 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3505673b-9aaa-41bc-b39e-f7e68dc278db None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:19:59.280914 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3505673b-9aaa-41bc-b39e-f7e68dc278db None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:19:59.282581 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3505673b-9aaa-41bc-b39e-f7e68dc278db None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:19:59.283320 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3505673b-9aaa-41bc-b39e-f7e68dc278db None None] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:19:59.283743 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3505673b-9aaa-41bc-b39e-f7e68dc278db None None] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:19:59.285812 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3505673b-9aaa-41bc-b39e-f7e68dc278db None None] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:19:59.287833 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO dbcounter [None req-3505673b-9aaa-41bc-b39e-f7e68dc278db None None] Registered counter for database nova_cell0 Aug 27 02:19:59.292275 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO dbcounter [None req-3505673b-9aaa-41bc-b39e-f7e68dc278db None None] Registered counter for database nova_cell1 Aug 27 02:19:59.300469 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_db.sqlalchemy.engines [None req-3505673b-9aaa-41bc-b39e-f7e68dc278db None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120782) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 02:19:59.302176 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_db.sqlalchemy.engines [None req-3505673b-9aaa-41bc-b39e-f7e68dc278db None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120782) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 02:19:59.309025 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writer thread running {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 02:19:59.310624 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writer thread running {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 02:19:59.379932 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO dbcounter [None req-3cd92c64-4d60-4a43-859a-05244fbe3fdd None None] Registered counter for database nova_cell0 Aug 27 02:19:59.387163 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_db.sqlalchemy.engines [None req-3cd92c64-4d60-4a43-859a-05244fbe3fdd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120783) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 02:19:59.392180 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writer thread running {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 02:19:59.456033 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO dbcounter [None req-3505673b-9aaa-41bc-b39e-f7e68dc278db None None] Registered counter for database nova_cell0 Aug 27 02:19:59.462815 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_db.sqlalchemy.engines [None req-3505673b-9aaa-41bc-b39e-f7e68dc278db None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120782) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 02:19:59.467831 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writer thread running {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 02:19:59.709635 dv-cinder-846303-3-smb devstack@n-api.service[120783]: WARNING keystonemiddleware.auth_token [None req-3cd92c64-4d60-4a43-859a-05244fbe3fdd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 27 02:19:59.717011 dv-cinder-846303-3-smb devstack@n-api.service[120783]: WARNING keystonemiddleware.auth_token [None req-3cd92c64-4d60-4a43-859a-05244fbe3fdd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 27 02:19:59.782472 dv-cinder-846303-3-smb devstack@n-api.service[120782]: WARNING keystonemiddleware.auth_token [None req-3505673b-9aaa-41bc-b39e-f7e68dc278db None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 27 02:19:59.789899 dv-cinder-846303-3-smb devstack@n-api.service[120782]: WARNING keystonemiddleware.auth_token [None req-3505673b-9aaa-41bc-b39e-f7e68dc278db None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 27 02:20:00.066035 dv-cinder-846303-3-smb devstack@n-api.service[120783]: WARNING keystonemiddleware.auth_token [None req-3cd92c64-4d60-4a43-859a-05244fbe3fdd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 27 02:20:00.072129 dv-cinder-846303-3-smb devstack@n-api.service[120783]: WARNING keystonemiddleware.auth_token [None req-3cd92c64-4d60-4a43-859a-05244fbe3fdd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 27 02:20:00.077497 dv-cinder-846303-3-smb devstack@n-api.service[120783]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b7ea4359c0 pid: 120783 (default app) Aug 27 02:20:00.133340 dv-cinder-846303-3-smb devstack@n-api.service[120782]: WARNING keystonemiddleware.auth_token [None req-3505673b-9aaa-41bc-b39e-f7e68dc278db None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 27 02:20:00.139665 dv-cinder-846303-3-smb devstack@n-api.service[120782]: WARNING keystonemiddleware.auth_token [None req-3505673b-9aaa-41bc-b39e-f7e68dc278db None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 27 02:20:00.145372 dv-cinder-846303-3-smb devstack@n-api.service[120782]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b7ea4359c0 pid: 120782 (default app) Aug 27 02:20:39.961670 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-2652fc92-3d06-4311-bd8d-043c75810213 tempest-VolumesTestJSON-1630402659 tempest-VolumesTestJSON-1630402659-project] Calling method '.version_select at 0x7fd8095560d0>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:20:39.990888 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_api:SELECT=3 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:20:39.992011 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell0:SELECT=3 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:20:39.993789 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell1:SELECT=3 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:20:39.994795 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell0:SELECT=3 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:20:40.986710 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-2652fc92-3d06-4311-bd8d-043c75810213 tempest-VolumesTestJSON-1630402659 tempest-VolumesTestJSON-1630402659-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/6cd72a3a-3c76-4d9b-8b8b-fca92e39ed38" status: 200 len: 351 microversion: 2.1 time: 1.334647 Aug 27 02:20:40.987302 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 1/1] 10.222.0.61 () {58 vars in 1245 bytes} [Sat Aug 27 02:20:39 2022] GET /compute/v2.1/os-volumes/6cd72a3a-3c76-4d9b-8b8b-fca92e39ed38 => generated 351 bytes in 1337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:20:43.195306 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-62d53189-f4d6-4c25-8b49-0cd0d8ebd15f tempest-VolumesTestJSON-1630402659 tempest-VolumesTestJSON-1630402659-project] Calling method '.version_select at 0x7fd8095d40d0>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:20:43.276990 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_api:SELECT=3 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:20:43.277945 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell0:SELECT=3 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:20:43.280480 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell1:SELECT=3 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:20:43.283319 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell0:SELECT=3 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:20:44.211976 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-62d53189-f4d6-4c25-8b49-0cd0d8ebd15f tempest-VolumesTestJSON-1630402659 tempest-VolumesTestJSON-1630402659-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/8b1a70c5-ea58-4cd4-8dd7-527c5dee9058" status: 200 len: 349 microversion: 2.1 time: 1.627801 Aug 27 02:20:44.225246 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 1/2] 10.222.0.61 () {58 vars in 1245 bytes} [Sat Aug 27 02:20:42 2022] GET /compute/v2.1/os-volumes/8b1a70c5-ea58-4cd4-8dd7-527c5dee9058 => generated 349 bytes in 1642 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:20:45.910904 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-3601d8eb-302d-42d5-b55f-ed3e459c6c44 tempest-VolumesTestJSON-1630402659 tempest-VolumesTestJSON-1630402659-project] Calling method '.version_select at 0x7fd80939aee0>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:20:46.049286 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-3601d8eb-302d-42d5-b55f-ed3e459c6c44 tempest-VolumesTestJSON-1630402659 tempest-VolumesTestJSON-1630402659-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/95ef8f79-eb9e-4aba-ac2e-5b00fb19b4ad" status: 200 len: 350 microversion: 2.1 time: 0.145150 Aug 27 02:20:46.050548 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 2/3] 10.222.0.61 () {58 vars in 1245 bytes} [Sat Aug 27 02:20:45 2022] GET /compute/v2.1/os-volumes/95ef8f79-eb9e-4aba-ac2e-5b00fb19b4ad => generated 350 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:20:46.065082 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-ead061ac-2ed7-4217-8c82-0317ff137f77 tempest-VolumesTestJSON-1630402659 tempest-VolumesTestJSON-1630402659-project] Calling method '.version_select at 0x7fd8093a7e50>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:20:46.343497 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-ead061ac-2ed7-4217-8c82-0317ff137f77 tempest-VolumesTestJSON-1630402659 tempest-VolumesTestJSON-1630402659-project] 10.222.0.61 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.282749 Aug 27 02:20:46.344506 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 2/4] 10.222.0.61 () {58 vars in 1134 bytes} [Sat Aug 27 02:20:46 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:20:46.358780 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-6bfcb58e-752e-49ba-abdd-a139da0b321c tempest-VolumesTestJSON-1630402659 tempest-VolumesTestJSON-1630402659-project] Calling method '.version_select at 0x7fd80939ab80>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:20:46.535754 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-6bfcb58e-752e-49ba-abdd-a139da0b321c tempest-VolumesTestJSON-1630402659 tempest-VolumesTestJSON-1630402659-project] 10.222.0.61 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 692 microversion: 2.1 time: 0.180656 Aug 27 02:20:46.536660 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 3/5] 10.222.0.61 () {58 vars in 1149 bytes} [Sat Aug 27 02:20:46 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 692 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:20:46.556254 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-03417617-09ec-4161-beab-74756f272096 tempest-VolumesTestJSON-1630402659 tempest-VolumesTestJSON-1630402659-project] Calling method '.version_select at 0x7fd809372af0>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:20:46.912578 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-03417617-09ec-4161-beab-74756f272096 tempest-VolumesTestJSON-1630402659 tempest-VolumesTestJSON-1630402659-project] 10.222.0.61 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.360578 Aug 27 02:20:46.913339 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 3/6] 10.222.0.61 () {58 vars in 1134 bytes} [Sat Aug 27 02:20:46 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:20:46.926437 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-a35b47e6-40a1-41ff-a1f0-a851c92507f2 tempest-VolumesTestJSON-1630402659 tempest-VolumesTestJSON-1630402659-project] Calling method '.version_select at 0x7fd80939ae50>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:20:47.037941 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-a35b47e6-40a1-41ff-a1f0-a851c92507f2 tempest-VolumesTestJSON-1630402659 tempest-VolumesTestJSON-1630402659-project] 10.222.0.61 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 352 microversion: 2.1 time: 0.115176 Aug 27 02:20:47.039008 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 4/7] 10.222.0.61 () {58 vars in 1167 bytes} [Sat Aug 27 02:20:46 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 352 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:20:47.053244 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-837030d8-b650-46f3-a99d-7a1255fd2f89 tempest-VolumesTestJSON-1630402659 tempest-VolumesTestJSON-1630402659-project] Calling method '.version_select at 0x7fd809cfb280>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:20:47.243653 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-837030d8-b650-46f3-a99d-7a1255fd2f89 tempest-VolumesTestJSON-1630402659 tempest-VolumesTestJSON-1630402659-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 692 microversion: 2.1 time: 0.194972 Aug 27 02:20:47.255436 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 4/8] 10.222.0.61 () {58 vars in 1170 bytes} [Sat Aug 27 02:20:47 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 692 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:20:47.260346 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-abbffa2c-e5a5-4980-82cc-aa0b738d38b2 tempest-VolumesTestJSON-1630402659 tempest-VolumesTestJSON-1630402659-project] Calling method '.version_select at 0x7fd80938d160>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:20:47.509588 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-abbffa2c-e5a5-4980-82cc-aa0b738d38b2 tempest-VolumesTestJSON-1630402659 tempest-VolumesTestJSON-1630402659-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.253310 Aug 27 02:20:47.518558 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 5/9] 10.222.0.61 () {58 vars in 1155 bytes} [Sat Aug 27 02:20:47 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:20:47.526777 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-4367321a-7355-4d18-b025-5d40fb399df5 tempest-VolumesTestJSON-1630402659 tempest-VolumesTestJSON-1630402659-project] Calling method '.version_select at 0x7fd809384040>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:20:47.719884 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-4367321a-7355-4d18-b025-5d40fb399df5 tempest-VolumesTestJSON-1630402659 tempest-VolumesTestJSON-1630402659-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 352 microversion: 2.1 time: 0.199343 Aug 27 02:20:47.729759 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 5/10] 10.222.0.61 () {58 vars in 1188 bytes} [Sat Aug 27 02:20:47 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 352 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:20:47.747824 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-2f2c6654-7363-41e9-8c5c-e5f3c4a259a9 tempest-VolumesTestJSON-1630402659 tempest-VolumesTestJSON-1630402659-project] Calling method '.version_select at 0x7fd80938d9d0>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:20:48.228703 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-2f2c6654-7363-41e9-8c5c-e5f3c4a259a9 tempest-VolumesTestJSON-1630402659 tempest-VolumesTestJSON-1630402659-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.497324 Aug 27 02:20:48.242940 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 6/11] 10.222.0.61 () {58 vars in 1155 bytes} [Sat Aug 27 02:20:47 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:20:50.803261 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-7cdebd83-da92-46b6-8dba-f7c482e482e1 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1881843416", "imageRef": "7d45cdd6-750f-40c7-9475-f7bf12fcb204", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:20:51.116806 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.network.neutron [None req-7cdebd83-da92-46b6-8dba-f7c482e482e1 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] validate_networks() for [('82c98610-ea02-4053-b24b-05eb88fd6050', None, None, None, None, None)] {{(pid=120782) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:20:54.243140 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-7cdebd83-da92-46b6-8dba-f7c482e482e1 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Flavor limits 0:0:0 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:20:54.244233 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-7cdebd83-da92-46b6-8dba-f7c482e482e1 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Image limits 0:0:0 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:20:54.244842 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-7cdebd83-da92-46b6-8dba-f7c482e482e1 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Flavor pref 0:0:0 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:20:54.245462 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-7cdebd83-da92-46b6-8dba-f7c482e482e1 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Image pref 0:0:0 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:20:54.246031 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-7cdebd83-da92-46b6-8dba-f7c482e482e1 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:20:54.280072 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7cdebd83-da92-46b6-8dba-f7c482e482e1 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:20:54.280953 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7cdebd83-da92-46b6-8dba-f7c482e482e1 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:20:54.281593 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7cdebd83-da92-46b6-8dba-f7c482e482e1 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:20:54.282512 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7cdebd83-da92-46b6-8dba-f7c482e482e1 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:20:54.283132 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7cdebd83-da92-46b6-8dba-f7c482e482e1 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:20:54.283717 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7cdebd83-da92-46b6-8dba-f7c482e482e1 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:20:54.433202 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.quota [None req-7cdebd83-da92-46b6-8dba-f7c482e482e1 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Getting quotas for project 67209b74f2fa4ae7ad9762d141378a5d. Resources: {'instances', 'ram', 'cores'} {{(pid=120782) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:20:54.452695 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.quota [None req-7cdebd83-da92-46b6-8dba-f7c482e482e1 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Getting quotas for user 1eb664209056410d890d1b2b8bfa0155 and project 67209b74f2fa4ae7ad9762d141378a5d. Resources: {'instances', 'ram', 'cores'} {{(pid=120782) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:20:54.510834 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-7cdebd83-da92-46b6-8dba-f7c482e482e1 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Going to run 1 instances... {{(pid=120782) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:20:54.519194 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-7cdebd83-da92-46b6-8dba-f7c482e482e1 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 7122531d-d371-4c4c-8d9f-fc74be8649c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7d45cdd6-750f-40c7-9475-f7bf12fcb204',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120782) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:20:54.743807 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-7cdebd83-da92-46b6-8dba-f7c482e482e1 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.138667 Aug 27 02:20:54.751330 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 6/12] 10.222.0.61 () {60 vars in 1147 bytes} [Sat Aug 27 02:20:50 2022] POST /compute/v2.1/servers => generated 383 bytes in 4141 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:20:54.757474 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-f22ffe4b-ec95-4183-9f73-f254e32c88a8 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:20:54.762174 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-f22ffe4b-ec95-4183-9f73-f254e32c88a8 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 7122531d-d371-4c4c-8d9f-fc74be8649c1] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:20:54.803982 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-bcd3ed3c-3edd-4eef-ae28-b05add56fa24 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Action: 'create', calling method: .version_select at 0x7fd8093754c0>, body: {"keypair": {"name": "tempest-keypair-1736570259", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBL5FTHjHCisLmIt1+0usF9S/eYSgNmHNp3g3yXlVGlJv8duDsVyzD8Qt/c2Quzs5XmjiOQ/zmdBmsnNMKE06gvliYyp2sxz6hv63yz9415EvrxqVZCq2PIEB70Qfy2MTQ=="}} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:20:55.056186 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.quota [None req-bcd3ed3c-3edd-4eef-ae28-b05add56fa24 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Getting quotas for project 8aa1c411b57d4e72885dac2b4f4dfe7a. Resources: {'key_pairs'} {{(pid=120783) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:20:55.091485 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.quota [None req-bcd3ed3c-3edd-4eef-ae28-b05add56fa24 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Getting quotas for user 4a6f819365574091ae344f14e47f487f and project 8aa1c411b57d4e72885dac2b4f4dfe7a. Resources: {'key_pairs'} {{(pid=120783) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:20:55.159939 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-f22ffe4b-ec95-4183-9f73-f254e32c88a8 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:20:55.211655 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-f22ffe4b-ec95-4183-9f73-f254e32c88a8 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/7122531d-d371-4c4c-8d9f-fc74be8649c1" status: 200 len: 1222 microversion: 2.1 time: 0.458098 Aug 27 02:20:55.214191 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 7/13] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:20:54 2022] GET /compute/v2.1/servers/7122531d-d371-4c4c-8d9f-fc74be8649c1 => generated 1222 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:20:55.256032 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-bcd3ed3c-3edd-4eef-ae28-b05add56fa24 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.707613 Aug 27 02:20:55.256872 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 7/14] 10.222.0.61 () {60 vars in 1159 bytes} [Sat Aug 27 02:20:54 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:20:55.521105 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-dd0bc8b2-cd8a-46da-81df-e2ebc2ffe3ae tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2090705304", "imageRef": "7d45cdd6-750f-40c7-9475-f7bf12fcb204", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:20:55.681142 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.network.neutron [None req-dd0bc8b2-cd8a-46da-81df-e2ebc2ffe3ae tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] validate_networks() for [('82c98610-ea02-4053-b24b-05eb88fd6050', None, None, None, None, None)] {{(pid=120782) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:20:57.192441 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-0d28daed-711c-44d6-a978-819a202bfc68 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1552695638", "imageRef": "7d45cdd6-750f-40c7-9475-f7bf12fcb204", "flavorRef": "452", "networks": [{"uuid": "aeb6ab66-451d-4759-90e9-c28580f4c8a3"}]}} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:20:57.413173 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.network.neutron [None req-0d28daed-711c-44d6-a978-819a202bfc68 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] validate_networks() for [('aeb6ab66-451d-4759-90e9-c28580f4c8a3', None, None, None, None, None)] {{(pid=120783) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:20:58.056912 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-dd0bc8b2-cd8a-46da-81df-e2ebc2ffe3ae tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Flavor limits 0:0:0 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:20:58.060145 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-dd0bc8b2-cd8a-46da-81df-e2ebc2ffe3ae tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Image limits 0:0:0 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:20:58.060767 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-dd0bc8b2-cd8a-46da-81df-e2ebc2ffe3ae tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Flavor pref 0:0:0 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:20:58.061189 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-dd0bc8b2-cd8a-46da-81df-e2ebc2ffe3ae tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Image pref 0:0:0 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:20:58.063361 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-dd0bc8b2-cd8a-46da-81df-e2ebc2ffe3ae tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:20:58.102465 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-dd0bc8b2-cd8a-46da-81df-e2ebc2ffe3ae tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:20:58.106456 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-dd0bc8b2-cd8a-46da-81df-e2ebc2ffe3ae tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:20:58.107542 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-dd0bc8b2-cd8a-46da-81df-e2ebc2ffe3ae tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:20:58.110291 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-dd0bc8b2-cd8a-46da-81df-e2ebc2ffe3ae tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:20:58.111452 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-dd0bc8b2-cd8a-46da-81df-e2ebc2ffe3ae tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:20:58.113779 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-dd0bc8b2-cd8a-46da-81df-e2ebc2ffe3ae tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:20:58.214424 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.quota [None req-dd0bc8b2-cd8a-46da-81df-e2ebc2ffe3ae tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Getting quotas for project 67209b74f2fa4ae7ad9762d141378a5d. Resources: {'instances', 'ram', 'cores'} {{(pid=120782) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:20:58.232561 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.quota [None req-dd0bc8b2-cd8a-46da-81df-e2ebc2ffe3ae tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Getting quotas for user 1eb664209056410d890d1b2b8bfa0155 and project 67209b74f2fa4ae7ad9762d141378a5d. Resources: {'instances', 'ram', 'cores'} {{(pid=120782) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:20:58.278875 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-dd0bc8b2-cd8a-46da-81df-e2ebc2ffe3ae tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Going to run 1 instances... {{(pid=120782) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:20:58.288445 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-dd0bc8b2-cd8a-46da-81df-e2ebc2ffe3ae tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 5cbe7ad9-5124-4014-9d2a-e877493b2a9e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7d45cdd6-750f-40c7-9475-f7bf12fcb204',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120782) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:20:58.442345 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-dd0bc8b2-cd8a-46da-81df-e2ebc2ffe3ae tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.925906 Aug 27 02:20:58.443013 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 8/15] 10.222.0.61 () {60 vars in 1147 bytes} [Sat Aug 27 02:20:55 2022] POST /compute/v2.1/servers => generated 383 bytes in 2927 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:20:58.458336 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-955626eb-8f42-4e5d-8d0d-eff6dcb58ed9 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:20:58.461431 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-955626eb-8f42-4e5d-8d0d-eff6dcb58ed9 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 5cbe7ad9-5124-4014-9d2a-e877493b2a9e] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:20:58.864587 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-955626eb-8f42-4e5d-8d0d-eff6dcb58ed9 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:20:58.873472 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-955626eb-8f42-4e5d-8d0d-eff6dcb58ed9 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e" status: 200 len: 1222 microversion: 2.1 time: 0.423188 Aug 27 02:20:58.878455 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 9/16] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:20:58 2022] GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e => generated 1222 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:20:59.902774 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-2bd720b2-39d6-45c2-ae98-b6e459c0f63c tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:20:59.904906 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-2bd720b2-39d6-45c2-ae98-b6e459c0f63c tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 5cbe7ad9-5124-4014-9d2a-e877493b2a9e] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:00.079533 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.virt.hardware [None req-0d28daed-711c-44d6-a978-819a202bfc68 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Flavor limits 0:0:0 {{(pid=120783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:21:00.080068 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.virt.hardware [None req-0d28daed-711c-44d6-a978-819a202bfc68 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Image limits 0:0:0 {{(pid=120783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:21:00.080367 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.virt.hardware [None req-0d28daed-711c-44d6-a978-819a202bfc68 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Flavor pref 0:0:0 {{(pid=120783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:21:00.080924 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.virt.hardware [None req-0d28daed-711c-44d6-a978-819a202bfc68 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Image pref 0:0:0 {{(pid=120783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:21:00.081507 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.virt.hardware [None req-0d28daed-711c-44d6-a978-819a202bfc68 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:21:00.120626 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0d28daed-711c-44d6-a978-819a202bfc68 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:00.121351 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0d28daed-711c-44d6-a978-819a202bfc68 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:00.124218 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0d28daed-711c-44d6-a978-819a202bfc68 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:00.130890 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0d28daed-711c-44d6-a978-819a202bfc68 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:00.131678 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0d28daed-711c-44d6-a978-819a202bfc68 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:00.132270 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0d28daed-711c-44d6-a978-819a202bfc68 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:00.188925 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.quota [None req-0d28daed-711c-44d6-a978-819a202bfc68 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Getting quotas for project b29ac730884f411b91b8cb922f7b0bea. Resources: {'instances', 'ram', 'cores'} {{(pid=120783) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:21:00.195954 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.quota [None req-0d28daed-711c-44d6-a978-819a202bfc68 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Getting quotas for user 8fcf84d1b6d04255b62ab22d35e80280 and project b29ac730884f411b91b8cb922f7b0bea. Resources: {'instances', 'ram', 'cores'} {{(pid=120783) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:21:00.214813 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-0d28daed-711c-44d6-a978-819a202bfc68 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Going to run 1 instances... {{(pid=120783) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:21:00.217605 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-2bd720b2-39d6-45c2-ae98-b6e459c0f63c tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:00.219976 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-0d28daed-711c-44d6-a978-819a202bfc68 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] [instance: 2c255852-5b9e-4539-a1a1-502d5b6b30cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7d45cdd6-750f-40c7-9475-f7bf12fcb204',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120783) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:21:00.226194 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-2bd720b2-39d6-45c2-ae98-b6e459c0f63c tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e" status: 200 len: 1222 microversion: 2.1 time: 0.326957 Aug 27 02:21:00.226442 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 10/17] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:20:59 2022] GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e => generated 1222 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:21:00.470313 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-0d28daed-711c-44d6-a978-819a202bfc68 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.569607 Aug 27 02:21:00.476567 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 8/18] 10.222.0.61 () {60 vars in 1147 bytes} [Sat Aug 27 02:20:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 3577 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:21:00.489505 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-f4146949-ed88-4529-a2b2-823d303aa5c6 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:00.490130 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-f4146949-ed88-4529-a2b2-823d303aa5c6 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] [instance: 2c255852-5b9e-4539-a1a1-502d5b6b30cb] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:00.920100 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-f4146949-ed88-4529-a2b2-823d303aa5c6 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fcf84d1b6d04255b62ab22d35e80280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29ac730884f411b91b8cb922f7b0bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:00.946862 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-f4146949-ed88-4529-a2b2-823d303aa5c6 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] 10.222.0.61 "GET /compute/v2.1/servers/2c255852-5b9e-4539-a1a1-502d5b6b30cb" status: 200 len: 1215 microversion: 2.1 time: 0.454178 Aug 27 02:21:00.948853 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 11/19] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:00 2022] GET /compute/v2.1/servers/2c255852-5b9e-4539-a1a1-502d5b6b30cb => generated 1215 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:21:01.249496 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-0b5eb134-81a9-4073-ac7d-2a18eb222606 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:01.250892 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-0b5eb134-81a9-4073-ac7d-2a18eb222606 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 5cbe7ad9-5124-4014-9d2a-e877493b2a9e] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:01.318229 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0b5eb134-81a9-4073-ac7d-2a18eb222606 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:01.340764 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0b5eb134-81a9-4073-ac7d-2a18eb222606 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:01.342340 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0b5eb134-81a9-4073-ac7d-2a18eb222606 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:01.346482 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0b5eb134-81a9-4073-ac7d-2a18eb222606 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:01.346975 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0b5eb134-81a9-4073-ac7d-2a18eb222606 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:01.347410 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0b5eb134-81a9-4073-ac7d-2a18eb222606 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:01.977040 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-0b5eb134-81a9-4073-ac7d-2a18eb222606 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:02.038759 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-0b5eb134-81a9-4073-ac7d-2a18eb222606 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e" status: 200 len: 1274 microversion: 2.1 time: 0.795386 Aug 27 02:21:02.039418 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 9/20] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:01 2022] GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e => generated 1274 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:21:02.080172 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-93475e48-4f2a-40ca-b459-1851bb5bb93b tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:02.089515 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-93475e48-4f2a-40ca-b459-1851bb5bb93b tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] [instance: 2c255852-5b9e-4539-a1a1-502d5b6b30cb] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:02.103547 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-93475e48-4f2a-40ca-b459-1851bb5bb93b tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:02.104320 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-93475e48-4f2a-40ca-b459-1851bb5bb93b tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:02.106454 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-93475e48-4f2a-40ca-b459-1851bb5bb93b tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:02.107408 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-93475e48-4f2a-40ca-b459-1851bb5bb93b tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:02.110585 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-93475e48-4f2a-40ca-b459-1851bb5bb93b tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:02.111317 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-93475e48-4f2a-40ca-b459-1851bb5bb93b tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:02.545625 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-e58ebf75-bd8f-4c69-9376-282b9a5e0dd4 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Action: 'create', calling method: .version_select at 0x7fd808a499d0>, body: {"keypair": {"name": "tempest-keypair-1345816608", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGw2CqLwNh/+wa51lO/Q+typttHrrbtUb2y3+KnBnqlyoAy9gNl4vdpHDNpqXoo1yuUm6xeExyZXq1pjTA7VbCLvc7HHd4xJT6Mgg2PB3EE5bxul7CZ+9H3wp+z8bqpHng=="}} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:21:02.747570 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.quota [None req-e58ebf75-bd8f-4c69-9376-282b9a5e0dd4 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Getting quotas for project 9409824440cb45508754064b55438edd. Resources: {'key_pairs'} {{(pid=120782) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:21:02.785263 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.quota [None req-e58ebf75-bd8f-4c69-9376-282b9a5e0dd4 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Getting quotas for user cd08f3b52004476b9eb532c7c68ab679 and project 9409824440cb45508754064b55438edd. Resources: {'key_pairs'} {{(pid=120782) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:21:02.948495 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-93475e48-4f2a-40ca-b459-1851bb5bb93b tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fcf84d1b6d04255b62ab22d35e80280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29ac730884f411b91b8cb922f7b0bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:02.963457 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-93475e48-4f2a-40ca-b459-1851bb5bb93b tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] 10.222.0.61 "GET /compute/v2.1/servers/2c255852-5b9e-4539-a1a1-502d5b6b30cb" status: 200 len: 1219 microversion: 2.1 time: 0.898896 Aug 27 02:21:02.969283 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 10/21] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:02 2022] GET /compute/v2.1/servers/2c255852-5b9e-4539-a1a1-502d5b6b30cb => generated 1219 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:21:02.973636 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-e58ebf75-bd8f-4c69-9376-282b9a5e0dd4 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.024718 Aug 27 02:21:02.989057 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 12/22] 10.222.0.61 () {62 vars in 1200 bytes} [Sat Aug 27 02:21:01 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1041 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 27 02:21:03.063638 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-63cf4033-430e-48f2-9d3c-1956300bf9ac tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:03.064472 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-63cf4033-430e-48f2-9d3c-1956300bf9ac tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 5cbe7ad9-5124-4014-9d2a-e877493b2a9e] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:03.074507 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-63cf4033-430e-48f2-9d3c-1956300bf9ac tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:03.084430 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-63cf4033-430e-48f2-9d3c-1956300bf9ac tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:03.086012 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-63cf4033-430e-48f2-9d3c-1956300bf9ac tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:03.094197 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-63cf4033-430e-48f2-9d3c-1956300bf9ac tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:03.095350 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-63cf4033-430e-48f2-9d3c-1956300bf9ac tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:03.096051 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-63cf4033-430e-48f2-9d3c-1956300bf9ac tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:03.587146 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-63cf4033-430e-48f2-9d3c-1956300bf9ac tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:03.607014 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-63cf4033-430e-48f2-9d3c-1956300bf9ac tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e" status: 200 len: 1280 microversion: 2.1 time: 0.540053 Aug 27 02:21:03.608525 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 11/23] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:03 2022] GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e => generated 1280 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:21:03.998506 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-81590213-5bb9-4620-88c7-c77ef54eb356 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:03.999256 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-81590213-5bb9-4620-88c7-c77ef54eb356 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] [instance: 2c255852-5b9e-4539-a1a1-502d5b6b30cb] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:04.012978 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-81590213-5bb9-4620-88c7-c77ef54eb356 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:04.013509 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-81590213-5bb9-4620-88c7-c77ef54eb356 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:04.013938 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-81590213-5bb9-4620-88c7-c77ef54eb356 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:04.014725 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-81590213-5bb9-4620-88c7-c77ef54eb356 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:04.015226 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-81590213-5bb9-4620-88c7-c77ef54eb356 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:04.019166 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-81590213-5bb9-4620-88c7-c77ef54eb356 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:04.629973 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-27a68dea-759a-4288-ad87-9d3d428224cd tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:04.630614 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-27a68dea-759a-4288-ad87-9d3d428224cd tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 5cbe7ad9-5124-4014-9d2a-e877493b2a9e] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:04.646235 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-27a68dea-759a-4288-ad87-9d3d428224cd tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:04.646739 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-27a68dea-759a-4288-ad87-9d3d428224cd tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:04.647228 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-27a68dea-759a-4288-ad87-9d3d428224cd tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:04.655406 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-27a68dea-759a-4288-ad87-9d3d428224cd tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:04.657243 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-27a68dea-759a-4288-ad87-9d3d428224cd tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:04.659744 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-27a68dea-759a-4288-ad87-9d3d428224cd tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:05.162650 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-27a68dea-759a-4288-ad87-9d3d428224cd tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:05.178501 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-27a68dea-759a-4288-ad87-9d3d428224cd tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e" status: 200 len: 1280 microversion: 2.1 time: 0.553228 Aug 27 02:21:05.195366 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 12/24] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:04 2022] GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e => generated 1280 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:21:05.248557 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-81590213-5bb9-4620-88c7-c77ef54eb356 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fcf84d1b6d04255b62ab22d35e80280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29ac730884f411b91b8cb922f7b0bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:05.279590 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-81590213-5bb9-4620-88c7-c77ef54eb356 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] 10.222.0.61 "GET /compute/v2.1/servers/2c255852-5b9e-4539-a1a1-502d5b6b30cb" status: 200 len: 1285 microversion: 2.1 time: 1.285770 Aug 27 02:21:05.294437 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 13/25] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:03 2022] GET /compute/v2.1/servers/2c255852-5b9e-4539-a1a1-502d5b6b30cb => generated 1285 bytes in 1301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:21:05.883288 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-01137e9c-7fd5-4443-b024-0504ef4c76fd tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1435042611", "imageRef": "7d45cdd6-750f-40c7-9475-f7bf12fcb204", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0a6b16e1-c045-4fdd-a4f5-57e1f8fdda65"}], "security_groups": [{"name": "tempest-securitygroup--754796243"}], "key_name": "tempest-keypair-1736570259", "user_data": "}} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:21:06.217442 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-d79367a6-1088-418e-abc4-abb89088e111 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:06.218640 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-d79367a6-1088-418e-abc4-abb89088e111 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 5cbe7ad9-5124-4014-9d2a-e877493b2a9e] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:06.247196 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d79367a6-1088-418e-abc4-abb89088e111 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:06.253074 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d79367a6-1088-418e-abc4-abb89088e111 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:06.259605 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d79367a6-1088-418e-abc4-abb89088e111 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:06.261948 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d79367a6-1088-418e-abc4-abb89088e111 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:06.269061 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d79367a6-1088-418e-abc4-abb89088e111 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:06.274198 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d79367a6-1088-418e-abc4-abb89088e111 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:06.683568 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.network.neutron [None req-01137e9c-7fd5-4443-b024-0504ef4c76fd tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] validate_networks() for [('0a6b16e1-c045-4fdd-a4f5-57e1f8fdda65', None, None, None, None, None)] {{(pid=120783) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:21:06.952211 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-d79367a6-1088-418e-abc4-abb89088e111 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:06.970898 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-d79367a6-1088-418e-abc4-abb89088e111 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e" status: 200 len: 1280 microversion: 2.1 time: 0.770041 Aug 27 02:21:06.974309 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 14/26] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:06 2022] GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e => generated 1280 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:21:06.980312 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-2710ac4b-3fbd-4db2-92a9-d6cc467f294a tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:06.992340 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-2710ac4b-3fbd-4db2-92a9-d6cc467f294a tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] [instance: 2c255852-5b9e-4539-a1a1-502d5b6b30cb] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:07.015067 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2710ac4b-3fbd-4db2-92a9-d6cc467f294a tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:07.015510 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2710ac4b-3fbd-4db2-92a9-d6cc467f294a tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:07.015962 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2710ac4b-3fbd-4db2-92a9-d6cc467f294a tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:07.016714 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2710ac4b-3fbd-4db2-92a9-d6cc467f294a tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:07.017177 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2710ac4b-3fbd-4db2-92a9-d6cc467f294a tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:07.017935 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2710ac4b-3fbd-4db2-92a9-d6cc467f294a tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:07.998671 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-2710ac4b-3fbd-4db2-92a9-d6cc467f294a tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fcf84d1b6d04255b62ab22d35e80280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29ac730884f411b91b8cb922f7b0bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:08.007595 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-2710ac4b-3fbd-4db2-92a9-d6cc467f294a tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] 10.222.0.61 "GET /compute/v2.1/servers/2c255852-5b9e-4539-a1a1-502d5b6b30cb" status: 200 len: 1273 microversion: 2.1 time: 1.032169 Aug 27 02:21:08.008179 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 15/27] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:06 2022] GET /compute/v2.1/servers/2c255852-5b9e-4539-a1a1-502d5b6b30cb => generated 1273 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:21:08.170409 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell0:SELECT=4 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:08.589533 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-bb3bd39c-dc55-41cf-8230-06c2673cb33d tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Action: 'create', calling method: .version_select at 0x7fd808937700>, body: {"keypair": {"name": "tempest-keypair-942727149", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIXjCN9ELZaVjyKOz9m2oH6PGQlVfahdNcALkJiMIBy/HgEIdeeqjvVvZhnmnk5Nf47lZoEAqNUKS5bnRAX0PxUWwiiczlBEE72n7qx2gwZJ7kc9BZqr2hYI3LiTEBkocA=="}} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:21:08.650017 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.quota [None req-bb3bd39c-dc55-41cf-8230-06c2673cb33d tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Getting quotas for project 782d9d02db5c49fda33321f2914a7f31. Resources: {'key_pairs'} {{(pid=120782) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:21:08.665333 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.quota [None req-bb3bd39c-dc55-41cf-8230-06c2673cb33d tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Getting quotas for user 22fbea2c71674b239e6d8fba6518e962 and project 782d9d02db5c49fda33321f2914a7f31. Resources: {'key_pairs'} {{(pid=120782) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:21:08.779088 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-bb3bd39c-dc55-41cf-8230-06c2673cb33d tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.763641 Aug 27 02:21:08.785057 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 16/28] 10.222.0.61 () {60 vars in 1159 bytes} [Sat Aug 27 02:21:08 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:21:08.817936 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-3cf3b27b-1d26-408a-a924-5bb63db5ef16 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:08.817936 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-3cf3b27b-1d26-408a-a924-5bb63db5ef16 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 5cbe7ad9-5124-4014-9d2a-e877493b2a9e] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:08.839192 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3cf3b27b-1d26-408a-a924-5bb63db5ef16 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:08.840615 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3cf3b27b-1d26-408a-a924-5bb63db5ef16 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:08.841075 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3cf3b27b-1d26-408a-a924-5bb63db5ef16 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:08.856543 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3cf3b27b-1d26-408a-a924-5bb63db5ef16 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:08.858667 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3cf3b27b-1d26-408a-a924-5bb63db5ef16 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:08.860677 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3cf3b27b-1d26-408a-a924-5bb63db5ef16 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:09.178270 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-3cf3b27b-1d26-408a-a924-5bb63db5ef16 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:09.210022 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-3cf3b27b-1d26-408a-a924-5bb63db5ef16 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e" status: 200 len: 1280 microversion: 2.1 time: 0.418394 Aug 27 02:21:09.211582 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 17/29] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:08 2022] GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e => generated 1280 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:21:09.218158 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-e7a6d480-e742-4a40-9280-5cdb79c54dbd tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:09.219644 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-e7a6d480-e742-4a40-9280-5cdb79c54dbd tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] [instance: 2c255852-5b9e-4539-a1a1-502d5b6b30cb] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:09.288483 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e7a6d480-e742-4a40-9280-5cdb79c54dbd tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:09.296153 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e7a6d480-e742-4a40-9280-5cdb79c54dbd tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:09.300599 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e7a6d480-e742-4a40-9280-5cdb79c54dbd tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:09.311422 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e7a6d480-e742-4a40-9280-5cdb79c54dbd tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:09.313628 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e7a6d480-e742-4a40-9280-5cdb79c54dbd tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:09.317737 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e7a6d480-e742-4a40-9280-5cdb79c54dbd tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:10.160655 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell0:SELECT=2 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:10.209836 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell0:SELECT=10 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:10.361191 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.virt.hardware [None req-01137e9c-7fd5-4443-b024-0504ef4c76fd tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Flavor limits 0:0:0 {{(pid=120783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:21:10.361779 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.virt.hardware [None req-01137e9c-7fd5-4443-b024-0504ef4c76fd tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Image limits 0:0:0 {{(pid=120783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:21:10.376617 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.virt.hardware [None req-01137e9c-7fd5-4443-b024-0504ef4c76fd tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Flavor pref 0:0:0 {{(pid=120783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:21:10.377508 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.virt.hardware [None req-01137e9c-7fd5-4443-b024-0504ef4c76fd tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Image pref 0:0:0 {{(pid=120783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:21:10.378181 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.virt.hardware [None req-01137e9c-7fd5-4443-b024-0504ef4c76fd tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:21:10.403584 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-01137e9c-7fd5-4443-b024-0504ef4c76fd tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:10.407970 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-01137e9c-7fd5-4443-b024-0504ef4c76fd tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:10.410849 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-01137e9c-7fd5-4443-b024-0504ef4c76fd tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:10.411926 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-01137e9c-7fd5-4443-b024-0504ef4c76fd tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:10.415599 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-01137e9c-7fd5-4443-b024-0504ef4c76fd tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:10.416196 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-01137e9c-7fd5-4443-b024-0504ef4c76fd tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:10.516539 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.quota [None req-01137e9c-7fd5-4443-b024-0504ef4c76fd tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Getting quotas for project 8aa1c411b57d4e72885dac2b4f4dfe7a. Resources: {'instances', 'ram', 'cores'} {{(pid=120783) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:21:10.556468 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.quota [None req-01137e9c-7fd5-4443-b024-0504ef4c76fd tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Getting quotas for user 4a6f819365574091ae344f14e47f487f and project 8aa1c411b57d4e72885dac2b4f4dfe7a. Resources: {'instances', 'ram', 'cores'} {{(pid=120783) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:21:10.633899 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-01137e9c-7fd5-4443-b024-0504ef4c76fd tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Going to run 1 instances... {{(pid=120783) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:21:10.636593 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-01137e9c-7fd5-4443-b024-0504ef4c76fd tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: 268d786c-398a-4305-85ac-545fa3b4370b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7d45cdd6-750f-40c7-9475-f7bf12fcb204',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120783) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:21:10.788800 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-01137e9c-7fd5-4443-b024-0504ef4c76fd tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 4.917111 Aug 27 02:21:10.797134 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 13/30] 10.222.0.61 () {60 vars in 1147 bytes} [Sat Aug 27 02:21:05 2022] POST /compute/v2.1/servers => generated 401 bytes in 4929 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:21:10.810620 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-7d83d6ab-ead2-48c9-af9d-04fc2cc61fe3 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:10.811235 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-7d83d6ab-ead2-48c9-af9d-04fc2cc61fe3 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 5cbe7ad9-5124-4014-9d2a-e877493b2a9e] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:10.838713 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7d83d6ab-ead2-48c9-af9d-04fc2cc61fe3 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:10.840620 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7d83d6ab-ead2-48c9-af9d-04fc2cc61fe3 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:10.841109 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7d83d6ab-ead2-48c9-af9d-04fc2cc61fe3 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:10.841883 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7d83d6ab-ead2-48c9-af9d-04fc2cc61fe3 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:10.849878 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7d83d6ab-ead2-48c9-af9d-04fc2cc61fe3 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:10.851743 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7d83d6ab-ead2-48c9-af9d-04fc2cc61fe3 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:11.090973 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-7d83d6ab-ead2-48c9-af9d-04fc2cc61fe3 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:11.105269 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-7d83d6ab-ead2-48c9-af9d-04fc2cc61fe3 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e" status: 200 len: 1280 microversion: 2.1 time: 0.306682 Aug 27 02:21:11.113560 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 14/31] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:10 2022] GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e => generated 1280 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:21:11.127840 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-10d9de14-b687-431a-9562-acf14d1c0295 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:11.128474 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-10d9de14-b687-431a-9562-acf14d1c0295 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: 268d786c-398a-4305-85ac-545fa3b4370b] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:11.305332 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-10d9de14-b687-431a-9562-acf14d1c0295 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6f819365574091ae344f14e47f487f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa1c411b57d4e72885dac2b4f4dfe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:11.354494 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-10d9de14-b687-431a-9562-acf14d1c0295 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/268d786c-398a-4305-85ac-545fa3b4370b" status: 200 len: 1242 microversion: 2.1 time: 0.239174 Aug 27 02:21:11.370014 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 15/32] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:11 2022] GET /compute/v2.1/servers/268d786c-398a-4305-85ac-545fa3b4370b => generated 1242 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:21:12.129888 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-cdbe5c7d-e86f-410d-9804-a8ce52df6d1f tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:12.130502 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-cdbe5c7d-e86f-410d-9804-a8ce52df6d1f tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 5cbe7ad9-5124-4014-9d2a-e877493b2a9e] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:12.136755 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-cdbe5c7d-e86f-410d-9804-a8ce52df6d1f tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:12.148252 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-cdbe5c7d-e86f-410d-9804-a8ce52df6d1f tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:12.148635 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-cdbe5c7d-e86f-410d-9804-a8ce52df6d1f tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:12.154155 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-cdbe5c7d-e86f-410d-9804-a8ce52df6d1f tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:12.158460 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-cdbe5c7d-e86f-410d-9804-a8ce52df6d1f tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:12.159151 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-cdbe5c7d-e86f-410d-9804-a8ce52df6d1f tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:12.521202 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-e7a6d480-e742-4a40-9280-5cdb79c54dbd tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fcf84d1b6d04255b62ab22d35e80280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29ac730884f411b91b8cb922f7b0bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:12.546510 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-e7a6d480-e742-4a40-9280-5cdb79c54dbd tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] 10.222.0.61 "GET /compute/v2.1/servers/2c255852-5b9e-4539-a1a1-502d5b6b30cb" status: 200 len: 1315 microversion: 2.1 time: 3.330884 Aug 27 02:21:12.548615 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 18/33] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:09 2022] GET /compute/v2.1/servers/2c255852-5b9e-4539-a1a1-502d5b6b30cb => generated 1315 bytes in 3336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:21:12.581227 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-808ca364-fac7-434f-9282-788b5a2aeb9d tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:12.582391 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-808ca364-fac7-434f-9282-788b5a2aeb9d tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: 268d786c-398a-4305-85ac-545fa3b4370b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:12.597192 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-808ca364-fac7-434f-9282-788b5a2aeb9d tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:12.602269 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-808ca364-fac7-434f-9282-788b5a2aeb9d tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:12.602954 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-808ca364-fac7-434f-9282-788b5a2aeb9d tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:12.603835 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-808ca364-fac7-434f-9282-788b5a2aeb9d tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:12.604461 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-808ca364-fac7-434f-9282-788b5a2aeb9d tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:12.605030 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-808ca364-fac7-434f-9282-788b5a2aeb9d tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:12.877278 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-808ca364-fac7-434f-9282-788b5a2aeb9d tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6f819365574091ae344f14e47f487f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa1c411b57d4e72885dac2b4f4dfe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:12.899577 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-808ca364-fac7-434f-9282-788b5a2aeb9d tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/268d786c-398a-4305-85ac-545fa3b4370b" status: 200 len: 1294 microversion: 2.1 time: 0.336486 Aug 27 02:21:12.903721 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 19/34] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:12 2022] GET /compute/v2.1/servers/268d786c-398a-4305-85ac-545fa3b4370b => generated 1294 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:21:13.560372 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-cdbe5c7d-e86f-410d-9804-a8ce52df6d1f tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:13.570400 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-cdbe5c7d-e86f-410d-9804-a8ce52df6d1f tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e" status: 200 len: 1322 microversion: 2.1 time: 1.444295 Aug 27 02:21:13.572543 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-5e524224-b14f-4e1d-8c7e-38926ac2d363 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:13.573278 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-5e524224-b14f-4e1d-8c7e-38926ac2d363 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] [instance: 2c255852-5b9e-4539-a1a1-502d5b6b30cb] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:13.576449 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 16/35] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:12 2022] GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e => generated 1322 bytes in 1451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:21:13.586389 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=8 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:13.589261 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5e524224-b14f-4e1d-8c7e-38926ac2d363 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:13.592717 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5e524224-b14f-4e1d-8c7e-38926ac2d363 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:13.593321 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5e524224-b14f-4e1d-8c7e-38926ac2d363 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:13.594201 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5e524224-b14f-4e1d-8c7e-38926ac2d363 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:13.601959 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5e524224-b14f-4e1d-8c7e-38926ac2d363 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:13.602709 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5e524224-b14f-4e1d-8c7e-38926ac2d363 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:13.930295 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-3fbc14f6-6dde-4eb9-9dc9-c7581e41bd93 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:13.930904 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-3fbc14f6-6dde-4eb9-9dc9-c7581e41bd93 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: 268d786c-398a-4305-85ac-545fa3b4370b] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:13.946154 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3fbc14f6-6dde-4eb9-9dc9-c7581e41bd93 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:13.946793 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3fbc14f6-6dde-4eb9-9dc9-c7581e41bd93 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:13.947081 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3fbc14f6-6dde-4eb9-9dc9-c7581e41bd93 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:13.947804 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3fbc14f6-6dde-4eb9-9dc9-c7581e41bd93 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:13.948258 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3fbc14f6-6dde-4eb9-9dc9-c7581e41bd93 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:13.948679 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3fbc14f6-6dde-4eb9-9dc9-c7581e41bd93 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:14.574229 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-3fbc14f6-6dde-4eb9-9dc9-c7581e41bd93 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6f819365574091ae344f14e47f487f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa1c411b57d4e72885dac2b4f4dfe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:14.606750 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-3fbc14f6-6dde-4eb9-9dc9-c7581e41bd93 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/268d786c-398a-4305-85ac-545fa3b4370b" status: 200 len: 1294 microversion: 2.1 time: 0.673938 Aug 27 02:21:14.610083 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 17/36] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:13 2022] GET /compute/v2.1/servers/268d786c-398a-4305-85ac-545fa3b4370b => generated 1294 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:21:14.622718 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-24112d6b-1d73-43dd-8efa-6bad50c65507 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:14.624045 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-24112d6b-1d73-43dd-8efa-6bad50c65507 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 5cbe7ad9-5124-4014-9d2a-e877493b2a9e] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:14.632931 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-24112d6b-1d73-43dd-8efa-6bad50c65507 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:14.634361 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-24112d6b-1d73-43dd-8efa-6bad50c65507 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:14.635303 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-24112d6b-1d73-43dd-8efa-6bad50c65507 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:14.647650 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-24112d6b-1d73-43dd-8efa-6bad50c65507 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:14.658151 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-24112d6b-1d73-43dd-8efa-6bad50c65507 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:14.658960 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-24112d6b-1d73-43dd-8efa-6bad50c65507 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:15.586788 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-5e524224-b14f-4e1d-8c7e-38926ac2d363 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fcf84d1b6d04255b62ab22d35e80280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29ac730884f411b91b8cb922f7b0bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:15.600342 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-5e524224-b14f-4e1d-8c7e-38926ac2d363 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] 10.222.0.61 "GET /compute/v2.1/servers/2c255852-5b9e-4539-a1a1-502d5b6b30cb" status: 200 len: 1315 microversion: 2.1 time: 2.031989 Aug 27 02:21:15.604970 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 20/37] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:13 2022] GET /compute/v2.1/servers/2c255852-5b9e-4539-a1a1-502d5b6b30cb => generated 1315 bytes in 2037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:21:15.808361 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-24112d6b-1d73-43dd-8efa-6bad50c65507 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:15.817079 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-24112d6b-1d73-43dd-8efa-6bad50c65507 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e" status: 200 len: 1322 microversion: 2.1 time: 1.205652 Aug 27 02:21:15.841719 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 18/38] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:14 2022] GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e => generated 1322 bytes in 1231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:21:15.860347 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-820b3c4d-642c-4c2b-b423-53bff6c5ceb5 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1740477830", "imageRef": "7d45cdd6-750f-40c7-9475-f7bf12fcb204", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c1dba08a-c583-4d5e-88a8-72a835e2f48b"}], "security_groups": [{"name": "tempest-securitygroup--926649026"}], "key_name": "tempest-keypair-1345816608", "user_data": "}} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:21:15.982798 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [req-adc4e1d9-b698-4406-8469-34ea63f94019 req-78eedb51-2ed4-484e-8ff0-a7576deddd89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7122531d-d371-4c4c-8d9f-fc74be8649c1", "tag": "63727c00-4d29-4b7f-af52-6ef68d39f55e"}]} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:21:16.019232 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-adc4e1d9-b698-4406-8469-34ea63f94019 req-78eedb51-2ed4-484e-8ff0-a7576deddd89 service nova] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:16.020126 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-adc4e1d9-b698-4406-8469-34ea63f94019 req-78eedb51-2ed4-484e-8ff0-a7576deddd89 service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:16.020715 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-adc4e1d9-b698-4406-8469-34ea63f94019 req-78eedb51-2ed4-484e-8ff0-a7576deddd89 service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:16.069268 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.compute.server_external_events [req-adc4e1d9-b698-4406-8469-34ea63f94019 req-78eedb51-2ed4-484e-8ff0-a7576deddd89 service nova] Creating event network-changed:63727c00-4d29-4b7f-af52-6ef68d39f55e for instance 7122531d-d371-4c4c-8d9f-fc74be8649c1 on hv-cinder-84630 Aug 27 02:21:16.070080 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-adc4e1d9-b698-4406-8469-34ea63f94019 req-78eedb51-2ed4-484e-8ff0-a7576deddd89 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120782) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 27 02:21:16.070615 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-adc4e1d9-b698-4406-8469-34ea63f94019 req-78eedb51-2ed4-484e-8ff0-a7576deddd89 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120782) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 27 02:21:16.071811 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-26d8e1ad-d766-4b47-b79d-10a82508cfd1 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:16.072422 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-26d8e1ad-d766-4b47-b79d-10a82508cfd1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:16.073021 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-26d8e1ad-d766-4b47-b79d-10a82508cfd1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:16.074044 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-26d8e1ad-d766-4b47-b79d-10a82508cfd1 None None] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:16.074640 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-26d8e1ad-d766-4b47-b79d-10a82508cfd1 None None] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:16.075205 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-26d8e1ad-d766-4b47-b79d-10a82508cfd1 None None] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:16.085474 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.compute.rpcapi [None req-26d8e1ad-d766-4b47-b79d-10a82508cfd1 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 27 02:21:16.086749 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-26d8e1ad-d766-4b47-b79d-10a82508cfd1 None None] Releasing lock "compute-rpcapi-router" {{(pid=120782) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 27 02:21:16.109280 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-26d8e1ad-d766-4b47-b79d-10a82508cfd1 None None] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.502756 Aug 27 02:21:16.110157 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 21/39] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Aug 27 02:21:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:21:16.117511 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-bb141535-8204-46bd-87c5-ef0c325bed38 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:16.121723 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-bb141535-8204-46bd-87c5-ef0c325bed38 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: 268d786c-398a-4305-85ac-545fa3b4370b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:16.137208 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-bb141535-8204-46bd-87c5-ef0c325bed38 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:16.137822 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-bb141535-8204-46bd-87c5-ef0c325bed38 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:16.138154 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-bb141535-8204-46bd-87c5-ef0c325bed38 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:16.138857 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-bb141535-8204-46bd-87c5-ef0c325bed38 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:16.139340 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-bb141535-8204-46bd-87c5-ef0c325bed38 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:16.139768 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-bb141535-8204-46bd-87c5-ef0c325bed38 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:16.366133 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.network.neutron [None req-820b3c4d-642c-4c2b-b423-53bff6c5ceb5 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] validate_networks() for [('c1dba08a-c583-4d5e-88a8-72a835e2f48b', None, None, None, None, None)] {{(pid=120783) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:21:16.445351 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-bb141535-8204-46bd-87c5-ef0c325bed38 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6f819365574091ae344f14e47f487f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa1c411b57d4e72885dac2b4f4dfe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:16.454659 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-bb141535-8204-46bd-87c5-ef0c325bed38 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/268d786c-398a-4305-85ac-545fa3b4370b" status: 200 len: 1300 microversion: 2.1 time: 0.343081 Aug 27 02:21:16.457332 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 22/40] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:16 2022] GET /compute/v2.1/servers/268d786c-398a-4305-85ac-545fa3b4370b => generated 1300 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:21:16.709705 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [req-aeb652bc-edff-49c3-82e2-d860d75ff4d4 req-cfe8c2fd-a434-4570-a573-6710bf656fc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c255852-5b9e-4539-a1a1-502d5b6b30cb", "tag": "a1b63727-ff86-45bf-bd1a-b38a61c8d845"}]} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:21:16.728512 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-aeb652bc-edff-49c3-82e2-d860d75ff4d4 req-cfe8c2fd-a434-4570-a573-6710bf656fc2 service nova] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:16.729215 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-aeb652bc-edff-49c3-82e2-d860d75ff4d4 req-cfe8c2fd-a434-4570-a573-6710bf656fc2 service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:16.729783 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-aeb652bc-edff-49c3-82e2-d860d75ff4d4 req-cfe8c2fd-a434-4570-a573-6710bf656fc2 service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:16.752784 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.compute.server_external_events [req-aeb652bc-edff-49c3-82e2-d860d75ff4d4 req-cfe8c2fd-a434-4570-a573-6710bf656fc2 service nova] Creating event network-changed:a1b63727-ff86-45bf-bd1a-b38a61c8d845 for instance 2c255852-5b9e-4539-a1a1-502d5b6b30cb on hv-cinder-84630 Aug 27 02:21:16.789919 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [req-aeb652bc-edff-49c3-82e2-d860d75ff4d4 req-cfe8c2fd-a434-4570-a573-6710bf656fc2 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.329854 Aug 27 02:21:16.796758 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 23/41] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Aug 27 02:21:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:21:16.813212 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-a740b95d-20de-45e1-89f0-a11fb049daca tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:16.815027 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-a740b95d-20de-45e1-89f0-a11fb049daca tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] [instance: 2c255852-5b9e-4539-a1a1-502d5b6b30cb] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:16.842596 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a740b95d-20de-45e1-89f0-a11fb049daca tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:16.845801 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a740b95d-20de-45e1-89f0-a11fb049daca tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:16.846706 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a740b95d-20de-45e1-89f0-a11fb049daca tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:16.848131 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a740b95d-20de-45e1-89f0-a11fb049daca tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:16.849243 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a740b95d-20de-45e1-89f0-a11fb049daca tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:16.850132 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a740b95d-20de-45e1-89f0-a11fb049daca tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:17.570469 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-a740b95d-20de-45e1-89f0-a11fb049daca tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fcf84d1b6d04255b62ab22d35e80280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29ac730884f411b91b8cb922f7b0bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:17.579727 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-a740b95d-20de-45e1-89f0-a11fb049daca tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] 10.222.0.61 "GET /compute/v2.1/servers/2c255852-5b9e-4539-a1a1-502d5b6b30cb" status: 200 len: 1315 microversion: 2.1 time: 0.779161 Aug 27 02:21:17.580622 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 24/42] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:16 2022] GET /compute/v2.1/servers/2c255852-5b9e-4539-a1a1-502d5b6b30cb => generated 1315 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:21:17.617817 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-25118d98-495d-477e-b95b-2518923ceb6c tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:17.619889 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-25118d98-495d-477e-b95b-2518923ceb6c tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 5cbe7ad9-5124-4014-9d2a-e877493b2a9e] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:17.628711 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-25118d98-495d-477e-b95b-2518923ceb6c tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:17.629620 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-25118d98-495d-477e-b95b-2518923ceb6c tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:17.634308 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-25118d98-495d-477e-b95b-2518923ceb6c tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:17.635948 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-25118d98-495d-477e-b95b-2518923ceb6c tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:17.640368 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-25118d98-495d-477e-b95b-2518923ceb6c tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:17.640998 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-25118d98-495d-477e-b95b-2518923ceb6c tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:17.849269 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-25118d98-495d-477e-b95b-2518923ceb6c tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:17.857856 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-25118d98-495d-477e-b95b-2518923ceb6c tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e" status: 200 len: 1322 microversion: 2.1 time: 0.275788 Aug 27 02:21:17.858785 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 25/43] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:17 2022] GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e => generated 1322 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:21:17.863504 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-56fab817-59d3-434d-80e8-ade15185ccdd tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:17.864389 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-56fab817-59d3-434d-80e8-ade15185ccdd tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: 268d786c-398a-4305-85ac-545fa3b4370b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:17.870361 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-56fab817-59d3-434d-80e8-ade15185ccdd tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:17.871007 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-56fab817-59d3-434d-80e8-ade15185ccdd tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:17.871572 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-56fab817-59d3-434d-80e8-ade15185ccdd tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:17.872402 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-56fab817-59d3-434d-80e8-ade15185ccdd tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:17.872985 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-56fab817-59d3-434d-80e8-ade15185ccdd tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:17.873604 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-56fab817-59d3-434d-80e8-ade15185ccdd tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:17.941996 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-56fab817-59d3-434d-80e8-ade15185ccdd tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6f819365574091ae344f14e47f487f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa1c411b57d4e72885dac2b4f4dfe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:17.951589 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-56fab817-59d3-434d-80e8-ade15185ccdd tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/268d786c-398a-4305-85ac-545fa3b4370b" status: 200 len: 1300 microversion: 2.1 time: 0.091745 Aug 27 02:21:17.952430 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 26/44] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:17 2022] GET /compute/v2.1/servers/268d786c-398a-4305-85ac-545fa3b4370b => generated 1300 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:21:18.353297 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.virt.hardware [None req-820b3c4d-642c-4c2b-b423-53bff6c5ceb5 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Flavor limits 0:0:0 {{(pid=120783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:21:18.354029 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.virt.hardware [None req-820b3c4d-642c-4c2b-b423-53bff6c5ceb5 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Image limits 0:0:0 {{(pid=120783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:21:18.354710 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.virt.hardware [None req-820b3c4d-642c-4c2b-b423-53bff6c5ceb5 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Flavor pref 0:0:0 {{(pid=120783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:21:18.355680 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.virt.hardware [None req-820b3c4d-642c-4c2b-b423-53bff6c5ceb5 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Image pref 0:0:0 {{(pid=120783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:21:18.356577 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.virt.hardware [None req-820b3c4d-642c-4c2b-b423-53bff6c5ceb5 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:21:18.388102 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-820b3c4d-642c-4c2b-b423-53bff6c5ceb5 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:18.388587 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-820b3c4d-642c-4c2b-b423-53bff6c5ceb5 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:18.389021 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-820b3c4d-642c-4c2b-b423-53bff6c5ceb5 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:18.389888 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-820b3c4d-642c-4c2b-b423-53bff6c5ceb5 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:18.390343 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-820b3c4d-642c-4c2b-b423-53bff6c5ceb5 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:18.390763 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-820b3c4d-642c-4c2b-b423-53bff6c5ceb5 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:18.411147 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.quota [None req-820b3c4d-642c-4c2b-b423-53bff6c5ceb5 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Getting quotas for project 9409824440cb45508754064b55438edd. Resources: {'instances', 'ram', 'cores'} {{(pid=120783) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:21:18.417412 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.quota [None req-820b3c4d-642c-4c2b-b423-53bff6c5ceb5 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Getting quotas for user cd08f3b52004476b9eb532c7c68ab679 and project 9409824440cb45508754064b55438edd. Resources: {'instances', 'ram', 'cores'} {{(pid=120783) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:21:18.451784 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-820b3c4d-642c-4c2b-b423-53bff6c5ceb5 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Going to run 1 instances... {{(pid=120783) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:21:18.460324 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-820b3c4d-642c-4c2b-b423-53bff6c5ceb5 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7d45cdd6-750f-40c7-9475-f7bf12fcb204',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120783) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:21:18.544738 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-820b3c4d-642c-4c2b-b423-53bff6c5ceb5 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.700727 Aug 27 02:21:18.552327 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 19/45] 10.222.0.61 () {62 vars in 1188 bytes} [Sat Aug 27 02:21:15 2022] POST /compute/v2.1/servers => generated 401 bytes in 2710 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 27 02:21:18.560454 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-d0be6fca-daee-4fa4-a274-32467740fecd tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:18.561895 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-d0be6fca-daee-4fa4-a274-32467740fecd tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:18.600867 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-1165ae41-ebb9-4279-8f0e-95f03c18b61a tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:18.602827 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-1165ae41-ebb9-4279-8f0e-95f03c18b61a tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] [instance: 2c255852-5b9e-4539-a1a1-502d5b6b30cb] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:18.633976 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1165ae41-ebb9-4279-8f0e-95f03c18b61a tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:18.634528 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1165ae41-ebb9-4279-8f0e-95f03c18b61a tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:18.634970 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1165ae41-ebb9-4279-8f0e-95f03c18b61a tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:18.635948 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1165ae41-ebb9-4279-8f0e-95f03c18b61a tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:18.636580 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1165ae41-ebb9-4279-8f0e-95f03c18b61a tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:18.637184 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1165ae41-ebb9-4279-8f0e-95f03c18b61a tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:18.717346 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-d0be6fca-daee-4fa4-a274-32467740fecd tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:18.729433 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-d0be6fca-daee-4fa4-a274-32467740fecd tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:18.731652 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-d0be6fca-daee-4fa4-a274-32467740fecd tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:18.735113 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-d0be6fca-daee-4fa4-a274-32467740fecd tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db" status: 200 len: 1282 microversion: 2.20 time: 0.181799 Aug 27 02:21:18.756646 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 27/46] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:21:18 2022] GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db => generated 1282 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:21:18.878075 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-5729ffb6-2ba2-427a-bcf1-ab749d304871 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:18.878933 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-5729ffb6-2ba2-427a-bcf1-ab749d304871 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 5cbe7ad9-5124-4014-9d2a-e877493b2a9e] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:18.888306 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5729ffb6-2ba2-427a-bcf1-ab749d304871 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:18.888782 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5729ffb6-2ba2-427a-bcf1-ab749d304871 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:18.893444 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5729ffb6-2ba2-427a-bcf1-ab749d304871 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:18.895618 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5729ffb6-2ba2-427a-bcf1-ab749d304871 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:18.896086 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5729ffb6-2ba2-427a-bcf1-ab749d304871 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:18.910064 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5729ffb6-2ba2-427a-bcf1-ab749d304871 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:19.484201 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-1165ae41-ebb9-4279-8f0e-95f03c18b61a tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fcf84d1b6d04255b62ab22d35e80280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29ac730884f411b91b8cb922f7b0bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:19.504052 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-1165ae41-ebb9-4279-8f0e-95f03c18b61a tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] 10.222.0.61 "GET /compute/v2.1/servers/2c255852-5b9e-4539-a1a1-502d5b6b30cb" status: 200 len: 1315 microversion: 2.1 time: 0.906301 Aug 27 02:21:19.522814 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 20/47] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:18 2022] GET /compute/v2.1/servers/2c255852-5b9e-4539-a1a1-502d5b6b30cb => generated 1315 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:21:19.539830 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [req-13917e88-910a-4e04-a215-1854ab579f20 req-688ab727-4837-45ef-8112-1c4c7851d43d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cbe7ad9-5124-4014-9d2a-e877493b2a9e", "tag": "b531113e-208a-4fe6-85c9-2bb5f663f84a"}]} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:21:19.571386 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-13917e88-910a-4e04-a215-1854ab579f20 req-688ab727-4837-45ef-8112-1c4c7851d43d service nova] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:19.572244 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-13917e88-910a-4e04-a215-1854ab579f20 req-688ab727-4837-45ef-8112-1c4c7851d43d service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:19.573081 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-13917e88-910a-4e04-a215-1854ab579f20 req-688ab727-4837-45ef-8112-1c4c7851d43d service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:19.615172 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.compute.server_external_events [req-13917e88-910a-4e04-a215-1854ab579f20 req-688ab727-4837-45ef-8112-1c4c7851d43d service nova] Creating event network-changed:b531113e-208a-4fe6-85c9-2bb5f663f84a for instance 5cbe7ad9-5124-4014-9d2a-e877493b2a9e on hv-cinder-84630 Aug 27 02:21:19.617576 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-13917e88-910a-4e04-a215-1854ab579f20 req-688ab727-4837-45ef-8112-1c4c7851d43d service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120783) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 27 02:21:19.619224 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-13917e88-910a-4e04-a215-1854ab579f20 req-688ab727-4837-45ef-8112-1c4c7851d43d service nova] Acquired lock "compute-rpcapi-router" {{(pid=120783) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 27 02:21:19.628568 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-24ae9f5f-0bbb-4705-9dda-19cd1960de07 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:19.629341 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-24ae9f5f-0bbb-4705-9dda-19cd1960de07 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:19.632263 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-24ae9f5f-0bbb-4705-9dda-19cd1960de07 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:19.637915 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-24ae9f5f-0bbb-4705-9dda-19cd1960de07 None None] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:19.639053 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-24ae9f5f-0bbb-4705-9dda-19cd1960de07 None None] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:19.639698 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-24ae9f5f-0bbb-4705-9dda-19cd1960de07 None None] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:19.656574 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-5729ffb6-2ba2-427a-bcf1-ab749d304871 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:19.663090 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.compute.rpcapi [None req-24ae9f5f-0bbb-4705-9dda-19cd1960de07 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 27 02:21:19.664273 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-24ae9f5f-0bbb-4705-9dda-19cd1960de07 None None] Releasing lock "compute-rpcapi-router" {{(pid=120783) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 27 02:21:19.682746 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-24ae9f5f-0bbb-4705-9dda-19cd1960de07 None None] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.156931 Aug 27 02:21:19.684634 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 21/48] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Aug 27 02:21:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:21:19.695118 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-9ca06216-b367-48fd-ae5e-eacc198cb523 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:19.697287 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-9ca06216-b367-48fd-ae5e-eacc198cb523 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: 268d786c-398a-4305-85ac-545fa3b4370b] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:19.697493 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-5729ffb6-2ba2-427a-bcf1-ab749d304871 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e" status: 200 len: 1322 microversion: 2.1 time: 0.798630 Aug 27 02:21:19.709720 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 28/49] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:18 2022] GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e => generated 1322 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:21:19.728768 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9ca06216-b367-48fd-ae5e-eacc198cb523 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:19.734177 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9ca06216-b367-48fd-ae5e-eacc198cb523 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:19.734639 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9ca06216-b367-48fd-ae5e-eacc198cb523 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:19.735383 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9ca06216-b367-48fd-ae5e-eacc198cb523 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:19.735836 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9ca06216-b367-48fd-ae5e-eacc198cb523 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:19.736257 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9ca06216-b367-48fd-ae5e-eacc198cb523 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:19.760654 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-f1bd4f3d-c613-4531-91b8-949fc72b2385 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:19.761261 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-f1bd4f3d-c613-4531-91b8-949fc72b2385 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:19.780505 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f1bd4f3d-c613-4531-91b8-949fc72b2385 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:19.782157 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f1bd4f3d-c613-4531-91b8-949fc72b2385 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:19.782596 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f1bd4f3d-c613-4531-91b8-949fc72b2385 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:19.791547 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f1bd4f3d-c613-4531-91b8-949fc72b2385 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:19.792149 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f1bd4f3d-c613-4531-91b8-949fc72b2385 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:19.792595 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f1bd4f3d-c613-4531-91b8-949fc72b2385 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:19.915245 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-f1bd4f3d-c613-4531-91b8-949fc72b2385 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:19.923544 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-f1bd4f3d-c613-4531-91b8-949fc72b2385 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:19.924983 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-f1bd4f3d-c613-4531-91b8-949fc72b2385 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:19.926134 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-f1bd4f3d-c613-4531-91b8-949fc72b2385 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db" status: 200 len: 1278 microversion: 2.20 time: 0.169974 Aug 27 02:21:19.926698 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 29/50] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:21:19 2022] GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db => generated 1278 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:21:20.193507 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-9ca06216-b367-48fd-ae5e-eacc198cb523 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6f819365574091ae344f14e47f487f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa1c411b57d4e72885dac2b4f4dfe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:20.201680 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-9ca06216-b367-48fd-ae5e-eacc198cb523 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/268d786c-398a-4305-85ac-545fa3b4370b" status: 200 len: 1367 microversion: 2.1 time: 0.515516 Aug 27 02:21:20.202255 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 22/51] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:19 2022] GET /compute/v2.1/servers/268d786c-398a-4305-85ac-545fa3b4370b => generated 1367 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:21:20.227245 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-9dd9cba1-4925-4fd0-9cd8-7aad235913a0 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-314882398", "imageRef": "7d45cdd6-750f-40c7-9475-f7bf12fcb204", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8633f64f-0c3f-48ab-92cc-dfeb181a68a4"}], "security_groups": [{"name": "tempest-securitygroup--708788510"}], "key_name": "tempest-keypair-942727149", "user_data": "}} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:21:20.367108 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.network.neutron [None req-9dd9cba1-4925-4fd0-9cd8-7aad235913a0 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] validate_networks() for [('8633f64f-0c3f-48ab-92cc-dfeb181a68a4', None, None, None, None, None)] {{(pid=120782) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:21:20.532445 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-804682ec-0cfc-443e-b64b-fd9617905563 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:20.534130 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-804682ec-0cfc-443e-b64b-fd9617905563 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] [instance: 2c255852-5b9e-4539-a1a1-502d5b6b30cb] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:20.553029 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-804682ec-0cfc-443e-b64b-fd9617905563 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:20.553572 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-804682ec-0cfc-443e-b64b-fd9617905563 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:20.554010 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-804682ec-0cfc-443e-b64b-fd9617905563 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:20.554964 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-804682ec-0cfc-443e-b64b-fd9617905563 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:20.555432 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-804682ec-0cfc-443e-b64b-fd9617905563 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:20.555855 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-804682ec-0cfc-443e-b64b-fd9617905563 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:20.885322 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-804682ec-0cfc-443e-b64b-fd9617905563 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fcf84d1b6d04255b62ab22d35e80280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29ac730884f411b91b8cb922f7b0bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:20.921350 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-804682ec-0cfc-443e-b64b-fd9617905563 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] 10.222.0.61 "GET /compute/v2.1/servers/2c255852-5b9e-4539-a1a1-502d5b6b30cb" status: 200 len: 1315 microversion: 2.1 time: 0.393012 Aug 27 02:21:20.923406 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 23/52] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:20 2022] GET /compute/v2.1/servers/2c255852-5b9e-4539-a1a1-502d5b6b30cb => generated 1315 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:21:20.958968 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-e013f40f-4918-485f-a9bc-4600419996b1 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:20.961344 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-e013f40f-4918-485f-a9bc-4600419996b1 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 5cbe7ad9-5124-4014-9d2a-e877493b2a9e] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:20.978821 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e013f40f-4918-485f-a9bc-4600419996b1 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:20.979359 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e013f40f-4918-485f-a9bc-4600419996b1 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:20.980694 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e013f40f-4918-485f-a9bc-4600419996b1 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:20.983408 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e013f40f-4918-485f-a9bc-4600419996b1 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:20.984715 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e013f40f-4918-485f-a9bc-4600419996b1 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:20.985591 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e013f40f-4918-485f-a9bc-4600419996b1 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:21.188709 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-9dd9cba1-4925-4fd0-9cd8-7aad235913a0 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Flavor limits 0:0:0 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:21:21.189222 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-9dd9cba1-4925-4fd0-9cd8-7aad235913a0 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Image limits 0:0:0 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:21:21.189902 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-9dd9cba1-4925-4fd0-9cd8-7aad235913a0 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Flavor pref 0:0:0 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:21:21.190926 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-9dd9cba1-4925-4fd0-9cd8-7aad235913a0 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Image pref 0:0:0 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:21:21.191659 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-9dd9cba1-4925-4fd0-9cd8-7aad235913a0 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:21:21.208664 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9dd9cba1-4925-4fd0-9cd8-7aad235913a0 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:21.209267 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9dd9cba1-4925-4fd0-9cd8-7aad235913a0 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:21.209934 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9dd9cba1-4925-4fd0-9cd8-7aad235913a0 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:21.210997 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9dd9cba1-4925-4fd0-9cd8-7aad235913a0 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:21.212237 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9dd9cba1-4925-4fd0-9cd8-7aad235913a0 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:21.213665 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9dd9cba1-4925-4fd0-9cd8-7aad235913a0 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:21.238067 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.quota [None req-9dd9cba1-4925-4fd0-9cd8-7aad235913a0 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Getting quotas for project 782d9d02db5c49fda33321f2914a7f31. Resources: {'instances', 'ram', 'cores'} {{(pid=120782) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:21:21.247035 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.quota [None req-9dd9cba1-4925-4fd0-9cd8-7aad235913a0 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Getting quotas for user 22fbea2c71674b239e6d8fba6518e962 and project 782d9d02db5c49fda33321f2914a7f31. Resources: {'instances', 'ram', 'cores'} {{(pid=120782) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:21:21.264244 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-9dd9cba1-4925-4fd0-9cd8-7aad235913a0 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Going to run 1 instances... {{(pid=120782) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:21:21.267249 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-9dd9cba1-4925-4fd0-9cd8-7aad235913a0 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 4fedf0d1-cc1c-4947-b92e-dcb4454889d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7d45cdd6-750f-40c7-9475-f7bf12fcb204',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120782) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:21:21.288533 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-e013f40f-4918-485f-a9bc-4600419996b1 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:21.296481 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-e013f40f-4918-485f-a9bc-4600419996b1 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e" status: 200 len: 1322 microversion: 2.1 time: 0.368016 Aug 27 02:21:21.311283 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 24/53] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:20 2022] GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e => generated 1322 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:21:21.322568 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-f4a955b0-e428-43ba-a932-b21049a429a3 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:21.323438 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-f4a955b0-e428-43ba-a932-b21049a429a3 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:21.333875 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f4a955b0-e428-43ba-a932-b21049a429a3 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:21.334646 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f4a955b0-e428-43ba-a932-b21049a429a3 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:21.335297 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f4a955b0-e428-43ba-a932-b21049a429a3 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:21.336851 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f4a955b0-e428-43ba-a932-b21049a429a3 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:21.337806 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f4a955b0-e428-43ba-a932-b21049a429a3 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:21.339146 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f4a955b0-e428-43ba-a932-b21049a429a3 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:21.349712 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-9dd9cba1-4925-4fd0-9cd8-7aad235913a0 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.127119 Aug 27 02:21:21.357127 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 30/54] 10.222.0.61 () {60 vars in 1147 bytes} [Sat Aug 27 02:21:20 2022] POST /compute/v2.1/servers => generated 401 bytes in 1135 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:21:21.363440 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-ccce282c-4ac2-41e4-942b-643a68d23ef3 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:21.364401 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-ccce282c-4ac2-41e4-942b-643a68d23ef3 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: 268d786c-398a-4305-85ac-545fa3b4370b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:21.372575 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ccce282c-4ac2-41e4-942b-643a68d23ef3 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:21.373480 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ccce282c-4ac2-41e4-942b-643a68d23ef3 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:21.374036 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ccce282c-4ac2-41e4-942b-643a68d23ef3 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:21.374896 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ccce282c-4ac2-41e4-942b-643a68d23ef3 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:21.375444 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ccce282c-4ac2-41e4-942b-643a68d23ef3 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:21.376466 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ccce282c-4ac2-41e4-942b-643a68d23ef3 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:21.740439 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-f4a955b0-e428-43ba-a932-b21049a429a3 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:21.755887 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-f4a955b0-e428-43ba-a932-b21049a429a3 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:21.757761 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-f4a955b0-e428-43ba-a932-b21049a429a3 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:21.762435 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-f4a955b0-e428-43ba-a932-b21049a429a3 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db" status: 200 len: 1278 microversion: 2.20 time: 0.445983 Aug 27 02:21:21.763848 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 25/55] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:21:21 2022] GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db => generated 1278 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:21:21.771448 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-fa2401cc-cc38-4081-801d-9c4c51f9f61d tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:21.775718 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-fa2401cc-cc38-4081-801d-9c4c51f9f61d tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 4fedf0d1-cc1c-4947-b92e-dcb4454889d1] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:21.795384 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:21.871831 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-ccce282c-4ac2-41e4-942b-643a68d23ef3 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6f819365574091ae344f14e47f487f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa1c411b57d4e72885dac2b4f4dfe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:21.881668 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-ccce282c-4ac2-41e4-942b-643a68d23ef3 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/268d786c-398a-4305-85ac-545fa3b4370b" status: 200 len: 1367 microversion: 2.1 time: 0.523060 Aug 27 02:21:21.883923 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 31/56] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:21 2022] GET /compute/v2.1/servers/268d786c-398a-4305-85ac-545fa3b4370b => generated 1367 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:21:21.946039 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-d8664d68-64d6-469e-aac9-69738786b9e7 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:21.947357 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-d8664d68-64d6-469e-aac9-69738786b9e7 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] [instance: 2c255852-5b9e-4539-a1a1-502d5b6b30cb] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:21.958747 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d8664d68-64d6-469e-aac9-69738786b9e7 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:21.960797 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d8664d68-64d6-469e-aac9-69738786b9e7 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:21.964068 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d8664d68-64d6-469e-aac9-69738786b9e7 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:21.965049 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d8664d68-64d6-469e-aac9-69738786b9e7 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:21.965758 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d8664d68-64d6-469e-aac9-69738786b9e7 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:21.966456 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d8664d68-64d6-469e-aac9-69738786b9e7 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:22.021448 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell1:SELECT=100 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:22.041998 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-fa2401cc-cc38-4081-801d-9c4c51f9f61d tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fbea2c71674b239e6d8fba6518e962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d9d02db5c49fda33321f2914a7f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:22.056543 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-fa2401cc-cc38-4081-801d-9c4c51f9f61d tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1" status: 200 len: 1236 microversion: 2.1 time: 0.291176 Aug 27 02:21:22.060555 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 26/57] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:21 2022] GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1 => generated 1236 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:21:22.319755 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-ffbad2da-02f7-4f7f-be16-b90f34335658 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:22.320372 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-ffbad2da-02f7-4f7f-be16-b90f34335658 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 5cbe7ad9-5124-4014-9d2a-e877493b2a9e] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:22.332599 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ffbad2da-02f7-4f7f-be16-b90f34335658 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:22.333083 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ffbad2da-02f7-4f7f-be16-b90f34335658 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:22.340361 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ffbad2da-02f7-4f7f-be16-b90f34335658 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:22.341152 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ffbad2da-02f7-4f7f-be16-b90f34335658 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:22.344269 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ffbad2da-02f7-4f7f-be16-b90f34335658 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:22.345052 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ffbad2da-02f7-4f7f-be16-b90f34335658 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:22.603961 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-d8664d68-64d6-469e-aac9-69738786b9e7 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fcf84d1b6d04255b62ab22d35e80280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29ac730884f411b91b8cb922f7b0bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:22.619891 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-d8664d68-64d6-469e-aac9-69738786b9e7 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] 10.222.0.61 "GET /compute/v2.1/servers/2c255852-5b9e-4539-a1a1-502d5b6b30cb" status: 200 len: 1315 microversion: 2.1 time: 0.677487 Aug 27 02:21:22.627174 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 32/58] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:21 2022] GET /compute/v2.1/servers/2c255852-5b9e-4539-a1a1-502d5b6b30cb => generated 1315 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:21:22.656601 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [req-b9f652ac-5900-4470-93ba-809bdd328285 req-4ebaac98-bc64-4845-93e9-7863f13113f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "268d786c-398a-4305-85ac-545fa3b4370b", "tag": "74ca1c59-a918-4f05-94e1-8a42c24359ab"}]} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:21:22.703013 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-b9f652ac-5900-4470-93ba-809bdd328285 req-4ebaac98-bc64-4845-93e9-7863f13113f9 service nova] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:22.703882 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-b9f652ac-5900-4470-93ba-809bdd328285 req-4ebaac98-bc64-4845-93e9-7863f13113f9 service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:22.706052 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-b9f652ac-5900-4470-93ba-809bdd328285 req-4ebaac98-bc64-4845-93e9-7863f13113f9 service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:22.723585 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.compute.server_external_events [req-b9f652ac-5900-4470-93ba-809bdd328285 req-4ebaac98-bc64-4845-93e9-7863f13113f9 service nova] Creating event network-changed:74ca1c59-a918-4f05-94e1-8a42c24359ab for instance 268d786c-398a-4305-85ac-545fa3b4370b on hv-cinder-84630 Aug 27 02:21:22.744434 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [req-b9f652ac-5900-4470-93ba-809bdd328285 req-4ebaac98-bc64-4845-93e9-7863f13113f9 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098869 Aug 27 02:21:22.745685 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 33/59] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Aug 27 02:21:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:21:22.765808 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-ffbad2da-02f7-4f7f-be16-b90f34335658 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:22.780732 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-ffbad2da-02f7-4f7f-be16-b90f34335658 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e" status: 200 len: 1322 microversion: 2.1 time: 0.464476 Aug 27 02:21:22.781480 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 27/60] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:22 2022] GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e => generated 1322 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:21:22.803768 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-147b6873-dc72-4a77-a6e3-86030f507a7b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:22.804569 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-147b6873-dc72-4a77-a6e3-86030f507a7b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:22.812743 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-147b6873-dc72-4a77-a6e3-86030f507a7b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:22.814857 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-147b6873-dc72-4a77-a6e3-86030f507a7b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:22.815339 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-147b6873-dc72-4a77-a6e3-86030f507a7b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:22.816080 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-147b6873-dc72-4a77-a6e3-86030f507a7b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:22.820316 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-147b6873-dc72-4a77-a6e3-86030f507a7b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:22.821063 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-147b6873-dc72-4a77-a6e3-86030f507a7b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:22.910015 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-219ae21f-c1c6-4bdf-bf60-0bdfbefc0819 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:22.910965 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-219ae21f-c1c6-4bdf-bf60-0bdfbefc0819 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: 268d786c-398a-4305-85ac-545fa3b4370b] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:22.917728 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-219ae21f-c1c6-4bdf-bf60-0bdfbefc0819 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:22.918349 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-219ae21f-c1c6-4bdf-bf60-0bdfbefc0819 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:22.918841 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-219ae21f-c1c6-4bdf-bf60-0bdfbefc0819 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:22.919598 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-219ae21f-c1c6-4bdf-bf60-0bdfbefc0819 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:22.920276 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-219ae21f-c1c6-4bdf-bf60-0bdfbefc0819 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:22.920798 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-219ae21f-c1c6-4bdf-bf60-0bdfbefc0819 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:22.932955 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-147b6873-dc72-4a77-a6e3-86030f507a7b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:22.947268 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-147b6873-dc72-4a77-a6e3-86030f507a7b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:22.949162 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-147b6873-dc72-4a77-a6e3-86030f507a7b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:22.957047 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-147b6873-dc72-4a77-a6e3-86030f507a7b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db" status: 200 len: 1340 microversion: 2.20 time: 0.168723 Aug 27 02:21:22.959423 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 34/61] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:21:22 2022] GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db => generated 1340 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:21:23.084184 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-b8ee6754-7887-48c9-880a-e442686edae7 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:23.085849 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-b8ee6754-7887-48c9-880a-e442686edae7 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 4fedf0d1-cc1c-4947-b92e-dcb4454889d1] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:23.096612 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b8ee6754-7887-48c9-880a-e442686edae7 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:23.103592 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b8ee6754-7887-48c9-880a-e442686edae7 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:23.107856 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b8ee6754-7887-48c9-880a-e442686edae7 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:23.108815 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b8ee6754-7887-48c9-880a-e442686edae7 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:23.110449 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b8ee6754-7887-48c9-880a-e442686edae7 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:23.111087 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b8ee6754-7887-48c9-880a-e442686edae7 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:23.267863 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-b8ee6754-7887-48c9-880a-e442686edae7 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fbea2c71674b239e6d8fba6518e962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d9d02db5c49fda33321f2914a7f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:23.276131 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-b8ee6754-7887-48c9-880a-e442686edae7 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1" status: 200 len: 1288 microversion: 2.1 time: 0.196036 Aug 27 02:21:23.279900 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 35/62] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:23 2022] GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1 => generated 1288 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:21:23.476735 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-219ae21f-c1c6-4bdf-bf60-0bdfbefc0819 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6f819365574091ae344f14e47f487f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa1c411b57d4e72885dac2b4f4dfe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:23.481590 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell1:SELECT=100 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:23.494069 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-219ae21f-c1c6-4bdf-bf60-0bdfbefc0819 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/268d786c-398a-4305-85ac-545fa3b4370b" status: 200 len: 1367 microversion: 2.1 time: 0.585330 Aug 27 02:21:23.494827 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 28/63] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:22 2022] GET /compute/v2.1/servers/268d786c-398a-4305-85ac-545fa3b4370b => generated 1367 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:21:23.652666 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-08ec0be3-f5a5-4316-a2f2-7e49ad5272fe tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:23.653946 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-08ec0be3-f5a5-4316-a2f2-7e49ad5272fe tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] [instance: 2c255852-5b9e-4539-a1a1-502d5b6b30cb] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:23.685720 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-08ec0be3-f5a5-4316-a2f2-7e49ad5272fe tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:23.687062 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-08ec0be3-f5a5-4316-a2f2-7e49ad5272fe tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:23.690323 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-08ec0be3-f5a5-4316-a2f2-7e49ad5272fe tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:23.691620 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-08ec0be3-f5a5-4316-a2f2-7e49ad5272fe tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:23.692282 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-08ec0be3-f5a5-4316-a2f2-7e49ad5272fe tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:23.693230 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-08ec0be3-f5a5-4316-a2f2-7e49ad5272fe tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:23.812389 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-616a2a7f-1dc3-41ca-a988-53576504fed0 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:23.813822 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-616a2a7f-1dc3-41ca-a988-53576504fed0 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 5cbe7ad9-5124-4014-9d2a-e877493b2a9e] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:23.836569 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-616a2a7f-1dc3-41ca-a988-53576504fed0 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:23.837587 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-616a2a7f-1dc3-41ca-a988-53576504fed0 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:23.838316 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-616a2a7f-1dc3-41ca-a988-53576504fed0 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:23.840622 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-616a2a7f-1dc3-41ca-a988-53576504fed0 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:23.841241 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-616a2a7f-1dc3-41ca-a988-53576504fed0 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:23.843665 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-616a2a7f-1dc3-41ca-a988-53576504fed0 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:24.214875 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-616a2a7f-1dc3-41ca-a988-53576504fed0 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:24.235878 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-616a2a7f-1dc3-41ca-a988-53576504fed0 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e" status: 200 len: 1322 microversion: 2.1 time: 0.431773 Aug 27 02:21:24.249934 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-08ec0be3-f5a5-4316-a2f2-7e49ad5272fe tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fcf84d1b6d04255b62ab22d35e80280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29ac730884f411b91b8cb922f7b0bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:24.250959 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 29/64] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:23 2022] GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e => generated 1322 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:21:24.268623 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-08ec0be3-f5a5-4316-a2f2-7e49ad5272fe tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] 10.222.0.61 "GET /compute/v2.1/servers/2c255852-5b9e-4539-a1a1-502d5b6b30cb" status: 200 len: 1315 microversion: 2.1 time: 0.622259 Aug 27 02:21:24.269607 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 36/65] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:23 2022] GET /compute/v2.1/servers/2c255852-5b9e-4539-a1a1-502d5b6b30cb => generated 1315 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:21:24.270367 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-c54940a4-229d-4444-8fcb-8d94473e75bc tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:24.271661 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-c54940a4-229d-4444-8fcb-8d94473e75bc tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:24.281030 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c54940a4-229d-4444-8fcb-8d94473e75bc tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:24.281866 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c54940a4-229d-4444-8fcb-8d94473e75bc tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:24.282494 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c54940a4-229d-4444-8fcb-8d94473e75bc tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:24.283393 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c54940a4-229d-4444-8fcb-8d94473e75bc tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:24.284352 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c54940a4-229d-4444-8fcb-8d94473e75bc tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:24.284999 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c54940a4-229d-4444-8fcb-8d94473e75bc tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:24.310341 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-86956b72-16c2-450a-a0fe-f45cb508b881 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:24.311018 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-86956b72-16c2-450a-a0fe-f45cb508b881 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 4fedf0d1-cc1c-4947-b92e-dcb4454889d1] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:24.329154 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-86956b72-16c2-450a-a0fe-f45cb508b881 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:24.329904 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-86956b72-16c2-450a-a0fe-f45cb508b881 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:24.332278 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-86956b72-16c2-450a-a0fe-f45cb508b881 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:24.336422 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-86956b72-16c2-450a-a0fe-f45cb508b881 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:24.337191 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-86956b72-16c2-450a-a0fe-f45cb508b881 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:24.337798 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-86956b72-16c2-450a-a0fe-f45cb508b881 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:24.822654 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-86956b72-16c2-450a-a0fe-f45cb508b881 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fbea2c71674b239e6d8fba6518e962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d9d02db5c49fda33321f2914a7f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:24.835627 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-86956b72-16c2-450a-a0fe-f45cb508b881 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1" status: 200 len: 1306 microversion: 2.1 time: 0.530896 Aug 27 02:21:24.837814 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 37/66] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:24 2022] GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1 => generated 1306 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:21:24.845572 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-7f19f1eb-2282-4e56-ae0d-76124effa663 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:24.846732 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-7f19f1eb-2282-4e56-ae0d-76124effa663 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: 268d786c-398a-4305-85ac-545fa3b4370b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:24.861947 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7f19f1eb-2282-4e56-ae0d-76124effa663 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:24.862798 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7f19f1eb-2282-4e56-ae0d-76124effa663 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:24.863318 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7f19f1eb-2282-4e56-ae0d-76124effa663 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:24.864254 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7f19f1eb-2282-4e56-ae0d-76124effa663 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:24.864829 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7f19f1eb-2282-4e56-ae0d-76124effa663 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:24.865530 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7f19f1eb-2282-4e56-ae0d-76124effa663 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:25.043108 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-c54940a4-229d-4444-8fcb-8d94473e75bc tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:25.065652 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-c54940a4-229d-4444-8fcb-8d94473e75bc tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:25.074778 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-c54940a4-229d-4444-8fcb-8d94473e75bc tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:25.077923 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-c54940a4-229d-4444-8fcb-8d94473e75bc tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db" status: 200 len: 1407 microversion: 2.20 time: 0.825361 Aug 27 02:21:25.079390 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 30/67] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:21:24 2022] GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db => generated 1407 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:21:25.191043 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [req-c025ccc2-938a-4a14-9875-a0e29eb4f187 req-6f9206d7-f22a-4f23-9c02-d08d9e7b1a4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c255852-5b9e-4539-a1a1-502d5b6b30cb", "name": "network-vif-plugged", "status": "completed", "tag": "a1b63727-ff86-45bf-bd1a-b38a61c8d845"}]} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:21:25.208115 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-c025ccc2-938a-4a14-9875-a0e29eb4f187 req-6f9206d7-f22a-4f23-9c02-d08d9e7b1a4d service nova] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:25.211033 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-c025ccc2-938a-4a14-9875-a0e29eb4f187 req-6f9206d7-f22a-4f23-9c02-d08d9e7b1a4d service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:25.211476 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-c025ccc2-938a-4a14-9875-a0e29eb4f187 req-6f9206d7-f22a-4f23-9c02-d08d9e7b1a4d service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:25.240658 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.compute.server_external_events [req-c025ccc2-938a-4a14-9875-a0e29eb4f187 req-6f9206d7-f22a-4f23-9c02-d08d9e7b1a4d service nova] Creating event network-vif-plugged:a1b63727-ff86-45bf-bd1a-b38a61c8d845 for instance 2c255852-5b9e-4539-a1a1-502d5b6b30cb on hv-cinder-84630 Aug 27 02:21:25.255135 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [req-c025ccc2-938a-4a14-9875-a0e29eb4f187 req-6f9206d7-f22a-4f23-9c02-d08d9e7b1a4d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.173982 Aug 27 02:21:25.255750 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 31/68] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Aug 27 02:21:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:21:25.275400 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-044c96b6-fa58-4cd0-ba35-261c6c817b9e tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:25.276347 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-044c96b6-fa58-4cd0-ba35-261c6c817b9e tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 5cbe7ad9-5124-4014-9d2a-e877493b2a9e] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:25.297492 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-044c96b6-fa58-4cd0-ba35-261c6c817b9e tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:25.298054 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-044c96b6-fa58-4cd0-ba35-261c6c817b9e tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:25.298498 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-044c96b6-fa58-4cd0-ba35-261c6c817b9e tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:25.299228 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-044c96b6-fa58-4cd0-ba35-261c6c817b9e tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:25.299674 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-044c96b6-fa58-4cd0-ba35-261c6c817b9e tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:25.300089 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-044c96b6-fa58-4cd0-ba35-261c6c817b9e tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:25.430526 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-7f19f1eb-2282-4e56-ae0d-76124effa663 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6f819365574091ae344f14e47f487f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa1c411b57d4e72885dac2b4f4dfe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:25.448680 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-7f19f1eb-2282-4e56-ae0d-76124effa663 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/268d786c-398a-4305-85ac-545fa3b4370b" status: 200 len: 1367 microversion: 2.1 time: 0.606941 Aug 27 02:21:25.454110 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 38/69] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:24 2022] GET /compute/v2.1/servers/268d786c-398a-4305-85ac-545fa3b4370b => generated 1367 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:21:25.481080 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-634f1a7f-a3b6-45bf-a72b-d7efc19df498 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:25.484429 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-634f1a7f-a3b6-45bf-a72b-d7efc19df498 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] [instance: 2c255852-5b9e-4539-a1a1-502d5b6b30cb] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:25.514547 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-634f1a7f-a3b6-45bf-a72b-d7efc19df498 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:25.518122 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-634f1a7f-a3b6-45bf-a72b-d7efc19df498 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:25.518709 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-634f1a7f-a3b6-45bf-a72b-d7efc19df498 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:25.520415 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-634f1a7f-a3b6-45bf-a72b-d7efc19df498 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:25.526072 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-634f1a7f-a3b6-45bf-a72b-d7efc19df498 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:25.528279 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-634f1a7f-a3b6-45bf-a72b-d7efc19df498 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:25.975126 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-044c96b6-fa58-4cd0-ba35-261c6c817b9e tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:25.990070 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-044c96b6-fa58-4cd0-ba35-261c6c817b9e tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e" status: 200 len: 1322 microversion: 2.1 time: 0.721588 Aug 27 02:21:25.998505 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 32/70] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:25 2022] GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e => generated 1322 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:21:26.009064 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-57eb9218-154d-4033-80a3-ce9bb62dbff4 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:26.013051 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-57eb9218-154d-4033-80a3-ce9bb62dbff4 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 4fedf0d1-cc1c-4947-b92e-dcb4454889d1] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:26.027380 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-57eb9218-154d-4033-80a3-ce9bb62dbff4 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:26.028122 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-57eb9218-154d-4033-80a3-ce9bb62dbff4 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:26.028703 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-57eb9218-154d-4033-80a3-ce9bb62dbff4 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:26.029685 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-57eb9218-154d-4033-80a3-ce9bb62dbff4 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:26.030295 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-57eb9218-154d-4033-80a3-ce9bb62dbff4 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:26.031459 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-634f1a7f-a3b6-45bf-a72b-d7efc19df498 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fcf84d1b6d04255b62ab22d35e80280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29ac730884f411b91b8cb922f7b0bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:26.034032 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-57eb9218-154d-4033-80a3-ce9bb62dbff4 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:26.041354 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-634f1a7f-a3b6-45bf-a72b-d7efc19df498 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] 10.222.0.61 "GET /compute/v2.1/servers/2c255852-5b9e-4539-a1a1-502d5b6b30cb" status: 200 len: 1315 microversion: 2.1 time: 0.586114 Aug 27 02:21:26.060755 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 39/71] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:25 2022] GET /compute/v2.1/servers/2c255852-5b9e-4539-a1a1-502d5b6b30cb => generated 1315 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:21:26.102197 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-52205c69-ae2d-470d-b7b0-827bf2cbee17 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:26.102874 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-52205c69-ae2d-470d-b7b0-827bf2cbee17 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:26.118978 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-52205c69-ae2d-470d-b7b0-827bf2cbee17 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:26.119386 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-52205c69-ae2d-470d-b7b0-827bf2cbee17 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:26.119988 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-52205c69-ae2d-470d-b7b0-827bf2cbee17 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:26.121045 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-52205c69-ae2d-470d-b7b0-827bf2cbee17 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:26.121769 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-52205c69-ae2d-470d-b7b0-827bf2cbee17 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:26.122252 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-52205c69-ae2d-470d-b7b0-827bf2cbee17 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:26.175069 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-57eb9218-154d-4033-80a3-ce9bb62dbff4 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fbea2c71674b239e6d8fba6518e962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d9d02db5c49fda33321f2914a7f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:26.189641 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-57eb9218-154d-4033-80a3-ce9bb62dbff4 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1" status: 200 len: 1294 microversion: 2.1 time: 0.188172 Aug 27 02:21:26.191755 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 33/72] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:25 2022] GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1 => generated 1294 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:21:26.262191 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [req-f95e03d7-7945-4f0a-80f8-9075bcaebdb6 req-43487f97-cc54-4504-8c92-8e6b33b51177 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47d706cc-4f9b-4d59-8eca-caae165ec5db", "tag": "118e8d55-f026-4cab-95af-2825721ac127"}]} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:21:26.276419 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-f95e03d7-7945-4f0a-80f8-9075bcaebdb6 req-43487f97-cc54-4504-8c92-8e6b33b51177 service nova] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:26.277253 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-f95e03d7-7945-4f0a-80f8-9075bcaebdb6 req-43487f97-cc54-4504-8c92-8e6b33b51177 service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:26.277863 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-f95e03d7-7945-4f0a-80f8-9075bcaebdb6 req-43487f97-cc54-4504-8c92-8e6b33b51177 service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:26.293121 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.compute.server_external_events [req-f95e03d7-7945-4f0a-80f8-9075bcaebdb6 req-43487f97-cc54-4504-8c92-8e6b33b51177 service nova] Creating event network-changed:118e8d55-f026-4cab-95af-2825721ac127 for instance 47d706cc-4f9b-4d59-8eca-caae165ec5db on hv-cinder-84630 Aug 27 02:21:26.310084 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [req-f95e03d7-7945-4f0a-80f8-9075bcaebdb6 req-43487f97-cc54-4504-8c92-8e6b33b51177 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050507 Aug 27 02:21:26.314903 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 34/73] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Aug 27 02:21:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:21:26.471921 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-0a615986-f665-423f-b4d8-7e54c0b7c881 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:26.472616 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-0a615986-f665-423f-b4d8-7e54c0b7c881 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: 268d786c-398a-4305-85ac-545fa3b4370b] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:26.485161 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0a615986-f665-423f-b4d8-7e54c0b7c881 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:26.485895 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0a615986-f665-423f-b4d8-7e54c0b7c881 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:26.487088 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0a615986-f665-423f-b4d8-7e54c0b7c881 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:26.490465 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0a615986-f665-423f-b4d8-7e54c0b7c881 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:26.495183 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0a615986-f665-423f-b4d8-7e54c0b7c881 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:26.496084 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0a615986-f665-423f-b4d8-7e54c0b7c881 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:26.568229 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-52205c69-ae2d-470d-b7b0-827bf2cbee17 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:26.584494 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-52205c69-ae2d-470d-b7b0-827bf2cbee17 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:26.586073 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-52205c69-ae2d-470d-b7b0-827bf2cbee17 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:26.587228 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-52205c69-ae2d-470d-b7b0-827bf2cbee17 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db" status: 200 len: 1407 microversion: 2.20 time: 0.489424 Aug 27 02:21:26.587902 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 40/74] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:21:26 2022] GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db => generated 1407 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:21:26.834906 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-0a615986-f665-423f-b4d8-7e54c0b7c881 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6f819365574091ae344f14e47f487f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa1c411b57d4e72885dac2b4f4dfe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:26.844722 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-0a615986-f665-423f-b4d8-7e54c0b7c881 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/268d786c-398a-4305-85ac-545fa3b4370b" status: 200 len: 1367 microversion: 2.1 time: 0.376836 Aug 27 02:21:26.846083 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 35/75] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:26 2022] GET /compute/v2.1/servers/268d786c-398a-4305-85ac-545fa3b4370b => generated 1367 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:21:27.015297 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-a91efaee-cd97-42a5-833a-e4b55ff48509 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:27.020145 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-a91efaee-cd97-42a5-833a-e4b55ff48509 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 5cbe7ad9-5124-4014-9d2a-e877493b2a9e] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:27.039525 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a91efaee-cd97-42a5-833a-e4b55ff48509 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:27.041989 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a91efaee-cd97-42a5-833a-e4b55ff48509 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:27.042749 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a91efaee-cd97-42a5-833a-e4b55ff48509 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:27.043699 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a91efaee-cd97-42a5-833a-e4b55ff48509 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:27.044847 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a91efaee-cd97-42a5-833a-e4b55ff48509 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:27.047894 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a91efaee-cd97-42a5-833a-e4b55ff48509 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:27.066805 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-b74b4e5b-4c8d-425c-87ef-dd901f44c0ef tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:27.068197 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-b74b4e5b-4c8d-425c-87ef-dd901f44c0ef tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] [instance: 2c255852-5b9e-4539-a1a1-502d5b6b30cb] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:27.080452 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b74b4e5b-4c8d-425c-87ef-dd901f44c0ef tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:27.080935 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b74b4e5b-4c8d-425c-87ef-dd901f44c0ef tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:27.081378 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b74b4e5b-4c8d-425c-87ef-dd901f44c0ef tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:27.082124 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b74b4e5b-4c8d-425c-87ef-dd901f44c0ef tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:27.082587 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b74b4e5b-4c8d-425c-87ef-dd901f44c0ef tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:27.083007 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b74b4e5b-4c8d-425c-87ef-dd901f44c0ef tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:27.384999 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-b74b4e5b-4c8d-425c-87ef-dd901f44c0ef tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fcf84d1b6d04255b62ab22d35e80280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29ac730884f411b91b8cb922f7b0bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:27.399649 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-b74b4e5b-4c8d-425c-87ef-dd901f44c0ef tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] 10.222.0.61 "GET /compute/v2.1/servers/2c255852-5b9e-4539-a1a1-502d5b6b30cb" status: 200 len: 1315 microversion: 2.1 time: 0.335525 Aug 27 02:21:27.400593 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 36/76] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:27 2022] GET /compute/v2.1/servers/2c255852-5b9e-4539-a1a1-502d5b6b30cb => generated 1315 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:21:27.430076 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-b9b358b6-8887-426a-8c82-198be42f3135 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:27.431387 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-b9b358b6-8887-426a-8c82-198be42f3135 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 4fedf0d1-cc1c-4947-b92e-dcb4454889d1] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:27.443099 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b9b358b6-8887-426a-8c82-198be42f3135 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:27.444130 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b9b358b6-8887-426a-8c82-198be42f3135 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:27.445069 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b9b358b6-8887-426a-8c82-198be42f3135 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:27.446480 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b9b358b6-8887-426a-8c82-198be42f3135 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:27.447242 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b9b358b6-8887-426a-8c82-198be42f3135 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:27.447871 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b9b358b6-8887-426a-8c82-198be42f3135 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:27.480085 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-a91efaee-cd97-42a5-833a-e4b55ff48509 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:27.502210 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-a91efaee-cd97-42a5-833a-e4b55ff48509 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e" status: 200 len: 1322 microversion: 2.1 time: 0.493201 Aug 27 02:21:27.514543 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 41/77] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:27 2022] GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e => generated 1322 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:21:27.610032 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-7a1c4dcf-feab-4055-b98a-dce95988f3e4 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:27.610703 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-7a1c4dcf-feab-4055-b98a-dce95988f3e4 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:27.618743 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7a1c4dcf-feab-4055-b98a-dce95988f3e4 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:27.620360 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7a1c4dcf-feab-4055-b98a-dce95988f3e4 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:27.621238 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7a1c4dcf-feab-4055-b98a-dce95988f3e4 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:27.622343 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7a1c4dcf-feab-4055-b98a-dce95988f3e4 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:27.624144 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7a1c4dcf-feab-4055-b98a-dce95988f3e4 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:27.624827 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7a1c4dcf-feab-4055-b98a-dce95988f3e4 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:27.846061 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-b9b358b6-8887-426a-8c82-198be42f3135 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fbea2c71674b239e6d8fba6518e962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d9d02db5c49fda33321f2914a7f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:27.872315 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-b9b358b6-8887-426a-8c82-198be42f3135 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1" status: 200 len: 1361 microversion: 2.1 time: 0.468853 Aug 27 02:21:27.907428 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 37/78] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:27 2022] GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1 => generated 1361 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:21:27.917539 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-7a1c4dcf-feab-4055-b98a-dce95988f3e4 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:27.927178 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-93e234e6-9a40-47a4-819b-f3299d623ca1 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:27.928210 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-93e234e6-9a40-47a4-819b-f3299d623ca1 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: 268d786c-398a-4305-85ac-545fa3b4370b] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:27.929986 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-7a1c4dcf-feab-4055-b98a-dce95988f3e4 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:27.936569 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-7a1c4dcf-feab-4055-b98a-dce95988f3e4 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:27.940068 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-7a1c4dcf-feab-4055-b98a-dce95988f3e4 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db" status: 200 len: 1407 microversion: 2.20 time: 0.334081 Aug 27 02:21:27.945030 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 42/79] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:21:27 2022] GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db => generated 1407 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:21:27.946148 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-93e234e6-9a40-47a4-819b-f3299d623ca1 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:27.946781 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-93e234e6-9a40-47a4-819b-f3299d623ca1 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:27.947517 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-93e234e6-9a40-47a4-819b-f3299d623ca1 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:27.948528 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-93e234e6-9a40-47a4-819b-f3299d623ca1 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:27.949108 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-93e234e6-9a40-47a4-819b-f3299d623ca1 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:27.949735 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-93e234e6-9a40-47a4-819b-f3299d623ca1 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:28.015151 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [req-516d76e7-8708-408e-9bee-a6c682d681a9 req-df40d4c4-72f6-4ff2-ac7e-0a37b4a2dfd3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fedf0d1-cc1c-4947-b92e-dcb4454889d1", "tag": "4bd07b6a-31ef-4e06-8c83-8a4ce8a68542"}]} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:21:28.027926 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-516d76e7-8708-408e-9bee-a6c682d681a9 req-df40d4c4-72f6-4ff2-ac7e-0a37b4a2dfd3 service nova] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:28.028403 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-516d76e7-8708-408e-9bee-a6c682d681a9 req-df40d4c4-72f6-4ff2-ac7e-0a37b4a2dfd3 service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:28.028820 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-516d76e7-8708-408e-9bee-a6c682d681a9 req-df40d4c4-72f6-4ff2-ac7e-0a37b4a2dfd3 service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:28.063864 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.compute.server_external_events [req-516d76e7-8708-408e-9bee-a6c682d681a9 req-df40d4c4-72f6-4ff2-ac7e-0a37b4a2dfd3 service nova] Creating event network-changed:4bd07b6a-31ef-4e06-8c83-8a4ce8a68542 for instance 4fedf0d1-cc1c-4947-b92e-dcb4454889d1 on hv-cinder-84630 Aug 27 02:21:28.078823 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [req-516d76e7-8708-408e-9bee-a6c682d681a9 req-df40d4c4-72f6-4ff2-ac7e-0a37b4a2dfd3 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067926 Aug 27 02:21:28.084897 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 43/80] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Aug 27 02:21:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:21:28.126536 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [req-b67de5c9-8790-4080-af7e-3eca1d193769 req-537630bf-0e0f-4752-9ce8-e88f63ea9a1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7122531d-d371-4c4c-8d9f-fc74be8649c1", "name": "network-vif-plugged", "status": "completed", "tag": "63727c00-4d29-4b7f-af52-6ef68d39f55e"}]} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:21:28.144325 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-b67de5c9-8790-4080-af7e-3eca1d193769 req-537630bf-0e0f-4752-9ce8-e88f63ea9a1e service nova] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:28.146199 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-b67de5c9-8790-4080-af7e-3eca1d193769 req-537630bf-0e0f-4752-9ce8-e88f63ea9a1e service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:28.146833 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-b67de5c9-8790-4080-af7e-3eca1d193769 req-537630bf-0e0f-4752-9ce8-e88f63ea9a1e service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:28.174363 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.compute.server_external_events [req-b67de5c9-8790-4080-af7e-3eca1d193769 req-537630bf-0e0f-4752-9ce8-e88f63ea9a1e service nova] Creating event network-vif-plugged:63727c00-4d29-4b7f-af52-6ef68d39f55e for instance 7122531d-d371-4c4c-8d9f-fc74be8649c1 on hv-cinder-84630 Aug 27 02:21:28.182714 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [req-b67de5c9-8790-4080-af7e-3eca1d193769 req-537630bf-0e0f-4752-9ce8-e88f63ea9a1e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060964 Aug 27 02:21:28.188225 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 44/81] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Aug 27 02:21:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:21:28.194279 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-93e234e6-9a40-47a4-819b-f3299d623ca1 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6f819365574091ae344f14e47f487f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa1c411b57d4e72885dac2b4f4dfe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:28.205104 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-93e234e6-9a40-47a4-819b-f3299d623ca1 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/268d786c-398a-4305-85ac-545fa3b4370b" status: 200 len: 1367 microversion: 2.1 time: 0.296231 Aug 27 02:21:28.205931 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 38/82] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:27 2022] GET /compute/v2.1/servers/268d786c-398a-4305-85ac-545fa3b4370b => generated 1367 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:21:28.422028 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-0cbf4cce-d1cd-453b-b351-9d04361a7edc tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:28.422867 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-0cbf4cce-d1cd-453b-b351-9d04361a7edc tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] [instance: 2c255852-5b9e-4539-a1a1-502d5b6b30cb] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:28.436434 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0cbf4cce-d1cd-453b-b351-9d04361a7edc tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:28.436921 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0cbf4cce-d1cd-453b-b351-9d04361a7edc tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:28.437346 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0cbf4cce-d1cd-453b-b351-9d04361a7edc tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:28.438522 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0cbf4cce-d1cd-453b-b351-9d04361a7edc tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:28.439020 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0cbf4cce-d1cd-453b-b351-9d04361a7edc tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:28.439465 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0cbf4cce-d1cd-453b-b351-9d04361a7edc tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:28.528477 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-c6d6c5e8-366b-4253-9130-21105f4fc99b tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:28.530350 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-c6d6c5e8-366b-4253-9130-21105f4fc99b tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 5cbe7ad9-5124-4014-9d2a-e877493b2a9e] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:28.545072 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c6d6c5e8-366b-4253-9130-21105f4fc99b tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:28.546282 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c6d6c5e8-366b-4253-9130-21105f4fc99b tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:28.546870 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c6d6c5e8-366b-4253-9130-21105f4fc99b tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:28.547771 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c6d6c5e8-366b-4253-9130-21105f4fc99b tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:28.548487 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c6d6c5e8-366b-4253-9130-21105f4fc99b tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:28.548917 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c6d6c5e8-366b-4253-9130-21105f4fc99b tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:28.677794 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-0cbf4cce-d1cd-453b-b351-9d04361a7edc tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fcf84d1b6d04255b62ab22d35e80280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29ac730884f411b91b8cb922f7b0bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:28.690695 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-0cbf4cce-d1cd-453b-b351-9d04361a7edc tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] 10.222.0.61 "GET /compute/v2.1/servers/2c255852-5b9e-4539-a1a1-502d5b6b30cb" status: 200 len: 1315 microversion: 2.1 time: 0.273819 Aug 27 02:21:28.691536 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 45/83] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:28 2022] GET /compute/v2.1/servers/2c255852-5b9e-4539-a1a1-502d5b6b30cb => generated 1315 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:21:28.895074 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-1ccde997-d014-467b-8f40-fd7d841fd420 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:28.895776 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-1ccde997-d014-467b-8f40-fd7d841fd420 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 4fedf0d1-cc1c-4947-b92e-dcb4454889d1] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:28.902594 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1ccde997-d014-467b-8f40-fd7d841fd420 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:28.903320 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1ccde997-d014-467b-8f40-fd7d841fd420 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:28.904262 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1ccde997-d014-467b-8f40-fd7d841fd420 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:28.905909 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1ccde997-d014-467b-8f40-fd7d841fd420 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:28.906564 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1ccde997-d014-467b-8f40-fd7d841fd420 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:28.907131 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1ccde997-d014-467b-8f40-fd7d841fd420 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:28.928794 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-c6d6c5e8-366b-4253-9130-21105f4fc99b tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:28.946984 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-c6d6c5e8-366b-4253-9130-21105f4fc99b tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e" status: 200 len: 1322 microversion: 2.1 time: 0.422219 Aug 27 02:21:28.948190 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 39/84] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:28 2022] GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e => generated 1322 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:21:28.978482 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-05b07d9c-fff2-4b3b-99b1-b8e23bf7dee0 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:28.981671 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-05b07d9c-fff2-4b3b-99b1-b8e23bf7dee0 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:29.001541 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-05b07d9c-fff2-4b3b-99b1-b8e23bf7dee0 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:29.002110 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-05b07d9c-fff2-4b3b-99b1-b8e23bf7dee0 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:29.003953 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-05b07d9c-fff2-4b3b-99b1-b8e23bf7dee0 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:29.006549 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-05b07d9c-fff2-4b3b-99b1-b8e23bf7dee0 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:29.008030 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-05b07d9c-fff2-4b3b-99b1-b8e23bf7dee0 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:29.009237 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-05b07d9c-fff2-4b3b-99b1-b8e23bf7dee0 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:29.128011 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-1ccde997-d014-467b-8f40-fd7d841fd420 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fbea2c71674b239e6d8fba6518e962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d9d02db5c49fda33321f2914a7f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:29.136916 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-1ccde997-d014-467b-8f40-fd7d841fd420 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1" status: 200 len: 1361 microversion: 2.1 time: 0.246972 Aug 27 02:21:29.137989 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 46/85] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:28 2022] GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1 => generated 1361 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:21:29.229447 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-da620823-a837-4673-89b9-4406ca166a91 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:29.229447 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-da620823-a837-4673-89b9-4406ca166a91 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: 268d786c-398a-4305-85ac-545fa3b4370b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:29.243323 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-da620823-a837-4673-89b9-4406ca166a91 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:29.244533 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-da620823-a837-4673-89b9-4406ca166a91 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:29.245531 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-da620823-a837-4673-89b9-4406ca166a91 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:29.247642 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-da620823-a837-4673-89b9-4406ca166a91 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:29.248541 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-da620823-a837-4673-89b9-4406ca166a91 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:29.250955 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-da620823-a837-4673-89b9-4406ca166a91 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:29.275452 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-05b07d9c-fff2-4b3b-99b1-b8e23bf7dee0 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:29.312886 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-05b07d9c-fff2-4b3b-99b1-b8e23bf7dee0 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:29.314377 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-05b07d9c-fff2-4b3b-99b1-b8e23bf7dee0 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:29.315528 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-05b07d9c-fff2-4b3b-99b1-b8e23bf7dee0 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db" status: 200 len: 1407 microversion: 2.20 time: 0.347528 Aug 27 02:21:29.316082 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 40/86] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:21:28 2022] GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db => generated 1407 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:21:29.664368 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-da620823-a837-4673-89b9-4406ca166a91 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6f819365574091ae344f14e47f487f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa1c411b57d4e72885dac2b4f4dfe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:29.676078 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-da620823-a837-4673-89b9-4406ca166a91 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/268d786c-398a-4305-85ac-545fa3b4370b" status: 200 len: 1367 microversion: 2.1 time: 0.452641 Aug 27 02:21:29.676663 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 47/87] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:29 2022] GET /compute/v2.1/servers/268d786c-398a-4305-85ac-545fa3b4370b => generated 1367 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:21:29.712063 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-7d2746ff-9795-4d1f-9a0f-a0b933c4d507 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:29.712782 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-7d2746ff-9795-4d1f-9a0f-a0b933c4d507 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] [instance: 2c255852-5b9e-4539-a1a1-502d5b6b30cb] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:29.722070 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell0:SELECT=6 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:29.737718 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7d2746ff-9795-4d1f-9a0f-a0b933c4d507 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:29.738535 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7d2746ff-9795-4d1f-9a0f-a0b933c4d507 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:29.739047 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7d2746ff-9795-4d1f-9a0f-a0b933c4d507 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:29.739856 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7d2746ff-9795-4d1f-9a0f-a0b933c4d507 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:29.740382 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7d2746ff-9795-4d1f-9a0f-a0b933c4d507 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:29.740874 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7d2746ff-9795-4d1f-9a0f-a0b933c4d507 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:29.971797 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-ee582107-127a-4233-afc3-59f45c1fc641 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:29.972407 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-ee582107-127a-4233-afc3-59f45c1fc641 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 5cbe7ad9-5124-4014-9d2a-e877493b2a9e] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:29.990000 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ee582107-127a-4233-afc3-59f45c1fc641 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:29.990754 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ee582107-127a-4233-afc3-59f45c1fc641 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:29.991371 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ee582107-127a-4233-afc3-59f45c1fc641 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:29.992255 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ee582107-127a-4233-afc3-59f45c1fc641 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:29.992869 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ee582107-127a-4233-afc3-59f45c1fc641 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:29.993777 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ee582107-127a-4233-afc3-59f45c1fc641 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:30.035560 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-7d2746ff-9795-4d1f-9a0f-a0b933c4d507 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fcf84d1b6d04255b62ab22d35e80280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29ac730884f411b91b8cb922f7b0bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:30.043611 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-7d2746ff-9795-4d1f-9a0f-a0b933c4d507 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] 10.222.0.61 "GET /compute/v2.1/servers/2c255852-5b9e-4539-a1a1-502d5b6b30cb" status: 200 len: 1503 microversion: 2.1 time: 0.335381 Aug 27 02:21:30.044182 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 41/88] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:29 2022] GET /compute/v2.1/servers/2c255852-5b9e-4539-a1a1-502d5b6b30cb => generated 1503 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:21:30.158123 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-accaafd9-5ca1-4b02-819d-baa8ef76f412 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:30.158600 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-accaafd9-5ca1-4b02-819d-baa8ef76f412 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 4fedf0d1-cc1c-4947-b92e-dcb4454889d1] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:30.173093 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-accaafd9-5ca1-4b02-819d-baa8ef76f412 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:30.174078 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-accaafd9-5ca1-4b02-819d-baa8ef76f412 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:30.174923 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-accaafd9-5ca1-4b02-819d-baa8ef76f412 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:30.175804 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-accaafd9-5ca1-4b02-819d-baa8ef76f412 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:30.176399 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-accaafd9-5ca1-4b02-819d-baa8ef76f412 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:30.177129 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-accaafd9-5ca1-4b02-819d-baa8ef76f412 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:30.472292 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-ee582107-127a-4233-afc3-59f45c1fc641 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:30.480398 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-ee582107-127a-4233-afc3-59f45c1fc641 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e" status: 200 len: 1322 microversion: 2.1 time: 0.517069 Aug 27 02:21:30.490047 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 48/89] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:29 2022] GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e => generated 1322 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:21:30.501544 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [req-d7a6d1dc-f9ee-4859-89ac-046d8f5f5a4b req-99da803f-9208-437e-82ea-88dcf7a17e06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cbe7ad9-5124-4014-9d2a-e877493b2a9e", "name": "network-vif-plugged", "status": "completed", "tag": "b531113e-208a-4fe6-85c9-2bb5f663f84a"}, {"server_uuid": "268d786c-398a-4305-85ac-545fa3b4370b", "name": "network-vif-plugged", "status": "completed", "tag": "74ca1c59-a918-4f05-94e1-8a42c24359ab"}]} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:21:30.525980 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-d7a6d1dc-f9ee-4859-89ac-046d8f5f5a4b req-99da803f-9208-437e-82ea-88dcf7a17e06 service nova] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:30.526465 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-d7a6d1dc-f9ee-4859-89ac-046d8f5f5a4b req-99da803f-9208-437e-82ea-88dcf7a17e06 service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:30.526896 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-d7a6d1dc-f9ee-4859-89ac-046d8f5f5a4b req-99da803f-9208-437e-82ea-88dcf7a17e06 service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:30.555040 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.compute.server_external_events [req-d7a6d1dc-f9ee-4859-89ac-046d8f5f5a4b req-99da803f-9208-437e-82ea-88dcf7a17e06 service nova] Creating event network-vif-plugged:b531113e-208a-4fe6-85c9-2bb5f663f84a for instance 5cbe7ad9-5124-4014-9d2a-e877493b2a9e on hv-cinder-84630 Aug 27 02:21:30.555548 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.compute.server_external_events [req-d7a6d1dc-f9ee-4859-89ac-046d8f5f5a4b req-99da803f-9208-437e-82ea-88dcf7a17e06 service nova] Creating event network-vif-plugged:74ca1c59-a918-4f05-94e1-8a42c24359ab for instance 268d786c-398a-4305-85ac-545fa3b4370b on hv-cinder-84630 Aug 27 02:21:30.572789 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [req-d7a6d1dc-f9ee-4859-89ac-046d8f5f5a4b req-99da803f-9208-437e-82ea-88dcf7a17e06 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.081403 Aug 27 02:21:30.577048 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 49/90] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Aug 27 02:21:30 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:21:30.588556 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-6ed31638-6dab-48c8-8f68-d7b1db8bd7f0 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:30.591514 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-6ed31638-6dab-48c8-8f68-d7b1db8bd7f0 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:30.608035 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6ed31638-6dab-48c8-8f68-d7b1db8bd7f0 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:30.608771 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6ed31638-6dab-48c8-8f68-d7b1db8bd7f0 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:30.609364 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6ed31638-6dab-48c8-8f68-d7b1db8bd7f0 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:30.613189 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6ed31638-6dab-48c8-8f68-d7b1db8bd7f0 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:30.614560 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6ed31638-6dab-48c8-8f68-d7b1db8bd7f0 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:30.615156 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6ed31638-6dab-48c8-8f68-d7b1db8bd7f0 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:30.773200 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-accaafd9-5ca1-4b02-819d-baa8ef76f412 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fbea2c71674b239e6d8fba6518e962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d9d02db5c49fda33321f2914a7f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:30.783891 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-accaafd9-5ca1-4b02-819d-baa8ef76f412 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1" status: 200 len: 1361 microversion: 2.1 time: 0.630014 Aug 27 02:21:30.785036 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 42/91] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:30 2022] GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1 => generated 1361 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:21:30.799994 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-9f1a0b00-22eb-4224-986c-ed605eb34af9 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:30.801027 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-9f1a0b00-22eb-4224-986c-ed605eb34af9 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: 268d786c-398a-4305-85ac-545fa3b4370b] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:30.809693 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9f1a0b00-22eb-4224-986c-ed605eb34af9 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:30.818903 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9f1a0b00-22eb-4224-986c-ed605eb34af9 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:30.820463 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9f1a0b00-22eb-4224-986c-ed605eb34af9 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:30.822149 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9f1a0b00-22eb-4224-986c-ed605eb34af9 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:30.823109 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9f1a0b00-22eb-4224-986c-ed605eb34af9 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:30.823991 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9f1a0b00-22eb-4224-986c-ed605eb34af9 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:30.896273 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-6ed31638-6dab-48c8-8f68-d7b1db8bd7f0 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:30.925444 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-6ed31638-6dab-48c8-8f68-d7b1db8bd7f0 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:30.929450 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-6ed31638-6dab-48c8-8f68-d7b1db8bd7f0 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:30.932976 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-6ed31638-6dab-48c8-8f68-d7b1db8bd7f0 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db" status: 200 len: 1407 microversion: 2.20 time: 0.354540 Aug 27 02:21:30.933811 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 50/92] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:21:30 2022] GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db => generated 1407 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:21:31.117443 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-9f1a0b00-22eb-4224-986c-ed605eb34af9 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6f819365574091ae344f14e47f487f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa1c411b57d4e72885dac2b4f4dfe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:31.129040 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-9f1a0b00-22eb-4224-986c-ed605eb34af9 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/268d786c-398a-4305-85ac-545fa3b4370b" status: 200 len: 1367 microversion: 2.1 time: 0.342506 Aug 27 02:21:31.130757 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 43/93] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:30 2022] GET /compute/v2.1/servers/268d786c-398a-4305-85ac-545fa3b4370b => generated 1367 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:21:31.503981 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-88cda438-d196-47a1-ac0d-5b25146c64df tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:31.504966 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-88cda438-d196-47a1-ac0d-5b25146c64df tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 5cbe7ad9-5124-4014-9d2a-e877493b2a9e] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:31.506731 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell0:SELECT=4 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:31.507393 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell0:SELECT=36 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:31.514336 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-88cda438-d196-47a1-ac0d-5b25146c64df tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:31.515061 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-88cda438-d196-47a1-ac0d-5b25146c64df tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:31.515651 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-88cda438-d196-47a1-ac0d-5b25146c64df tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:31.517247 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-88cda438-d196-47a1-ac0d-5b25146c64df tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:31.518046 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-88cda438-d196-47a1-ac0d-5b25146c64df tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:31.518622 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-88cda438-d196-47a1-ac0d-5b25146c64df tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:31.702589 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-88cda438-d196-47a1-ac0d-5b25146c64df tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:31.725922 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-40a7ecbc-26ee-4c2f-8bae-e4ea0fdf9e08 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ae126d63-d5e0-4b7f-9cb3-c30f7c2f8b55"}} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:21:31.728344 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-40a7ecbc-26ee-4c2f-8bae-e4ea0fdf9e08 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] [instance: 2c255852-5b9e-4539-a1a1-502d5b6b30cb] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:31.729014 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell1:SELECT=100 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:31.733306 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-88cda438-d196-47a1-ac0d-5b25146c64df tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e" status: 200 len: 1322 microversion: 2.1 time: 0.232721 Aug 27 02:21:31.743127 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-40a7ecbc-26ee-4c2f-8bae-e4ea0fdf9e08 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:31.745807 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-40a7ecbc-26ee-4c2f-8bae-e4ea0fdf9e08 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:31.746317 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-40a7ecbc-26ee-4c2f-8bae-e4ea0fdf9e08 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:31.747820 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-40a7ecbc-26ee-4c2f-8bae-e4ea0fdf9e08 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:31.748826 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-40a7ecbc-26ee-4c2f-8bae-e4ea0fdf9e08 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:31.750005 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-40a7ecbc-26ee-4c2f-8bae-e4ea0fdf9e08 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:31.760858 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 51/94] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:31 2022] GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e => generated 1322 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:21:31.807472 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-3b763d47-ae0d-4da2-8207-b9bd00706ae3 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:31.808025 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-3b763d47-ae0d-4da2-8207-b9bd00706ae3 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 4fedf0d1-cc1c-4947-b92e-dcb4454889d1] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:31.820479 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3b763d47-ae0d-4da2-8207-b9bd00706ae3 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:31.822016 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3b763d47-ae0d-4da2-8207-b9bd00706ae3 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:31.825484 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3b763d47-ae0d-4da2-8207-b9bd00706ae3 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:31.826884 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3b763d47-ae0d-4da2-8207-b9bd00706ae3 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:31.830023 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3b763d47-ae0d-4da2-8207-b9bd00706ae3 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:31.831145 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3b763d47-ae0d-4da2-8207-b9bd00706ae3 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:32.054041 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell0:SELECT=16 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:32.200459 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-3b763d47-ae0d-4da2-8207-b9bd00706ae3 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fbea2c71674b239e6d8fba6518e962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d9d02db5c49fda33321f2914a7f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:32.209610 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-3b763d47-ae0d-4da2-8207-b9bd00706ae3 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1" status: 200 len: 1361 microversion: 2.1 time: 0.406607 Aug 27 02:21:32.241523 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 52/95] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:31 2022] GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1 => generated 1361 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:21:32.250807 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-19977d8a-7bc2-4190-9f7b-a3fc2d988318 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:32.251761 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-19977d8a-7bc2-4190-9f7b-a3fc2d988318 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:32.260370 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-19977d8a-7bc2-4190-9f7b-a3fc2d988318 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:32.262996 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-19977d8a-7bc2-4190-9f7b-a3fc2d988318 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:32.264118 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-19977d8a-7bc2-4190-9f7b-a3fc2d988318 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:32.265088 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-19977d8a-7bc2-4190-9f7b-a3fc2d988318 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:32.265789 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-19977d8a-7bc2-4190-9f7b-a3fc2d988318 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:32.266411 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-19977d8a-7bc2-4190-9f7b-a3fc2d988318 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:32.492195 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-19977d8a-7bc2-4190-9f7b-a3fc2d988318 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:32.506400 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-19977d8a-7bc2-4190-9f7b-a3fc2d988318 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:32.507885 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-19977d8a-7bc2-4190-9f7b-a3fc2d988318 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:32.509853 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-19977d8a-7bc2-4190-9f7b-a3fc2d988318 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db" status: 200 len: 1407 microversion: 2.20 time: 0.266467 Aug 27 02:21:32.510421 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 53/96] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:21:32 2022] GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db => generated 1407 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:21:32.516400 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-6c91a10f-27ef-4b66-a0d1-3b9678ba4c63 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:32.516997 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-6c91a10f-27ef-4b66-a0d1-3b9678ba4c63 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: 268d786c-398a-4305-85ac-545fa3b4370b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:32.524925 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6c91a10f-27ef-4b66-a0d1-3b9678ba4c63 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:32.525446 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6c91a10f-27ef-4b66-a0d1-3b9678ba4c63 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:32.525887 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6c91a10f-27ef-4b66-a0d1-3b9678ba4c63 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:32.526696 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6c91a10f-27ef-4b66-a0d1-3b9678ba4c63 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:32.526999 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6c91a10f-27ef-4b66-a0d1-3b9678ba4c63 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:32.527413 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6c91a10f-27ef-4b66-a0d1-3b9678ba4c63 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:32.697600 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-6c91a10f-27ef-4b66-a0d1-3b9678ba4c63 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6f819365574091ae344f14e47f487f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa1c411b57d4e72885dac2b4f4dfe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:32.708545 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-6c91a10f-27ef-4b66-a0d1-3b9678ba4c63 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/268d786c-398a-4305-85ac-545fa3b4370b" status: 200 len: 1367 microversion: 2.1 time: 0.196508 Aug 27 02:21:32.709358 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 54/97] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:32 2022] GET /compute/v2.1/servers/268d786c-398a-4305-85ac-545fa3b4370b => generated 1367 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:21:32.771683 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-d6abdce8-6d54-48fa-ab05-87c23e149da5 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:32.772629 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-d6abdce8-6d54-48fa-ab05-87c23e149da5 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 5cbe7ad9-5124-4014-9d2a-e877493b2a9e] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:32.781690 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d6abdce8-6d54-48fa-ab05-87c23e149da5 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:32.782411 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d6abdce8-6d54-48fa-ab05-87c23e149da5 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:32.783022 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d6abdce8-6d54-48fa-ab05-87c23e149da5 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:32.783907 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d6abdce8-6d54-48fa-ab05-87c23e149da5 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:32.784479 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d6abdce8-6d54-48fa-ab05-87c23e149da5 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:32.785033 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d6abdce8-6d54-48fa-ab05-87c23e149da5 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:32.956985 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-d6abdce8-6d54-48fa-ab05-87c23e149da5 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:32.967951 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-d6abdce8-6d54-48fa-ab05-87c23e149da5 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e" status: 200 len: 1322 microversion: 2.1 time: 0.203341 Aug 27 02:21:32.969479 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 55/98] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:32 2022] GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e => generated 1322 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:21:32.992066 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-40a7ecbc-26ee-4c2f-8bae-e4ea0fdf9e08 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] 10.222.0.61 "POST /compute/v2.1/servers/2c255852-5b9e-4539-a1a1-502d5b6b30cb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.270730 Aug 27 02:21:32.992671 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 44/99] 10.222.0.61 () {60 vars in 1323 bytes} [Sat Aug 27 02:21:31 2022] POST /compute/v2.1/servers/2c255852-5b9e-4539-a1a1-502d5b6b30cb/os-volume_attachments => generated 194 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:21:33.237938 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-6a1ab2d5-f168-4617-a267-0be7bb276929 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:33.238653 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-6a1ab2d5-f168-4617-a267-0be7bb276929 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 4fedf0d1-cc1c-4947-b92e-dcb4454889d1] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:33.250024 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6a1ab2d5-f168-4617-a267-0be7bb276929 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:33.251194 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6a1ab2d5-f168-4617-a267-0be7bb276929 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:33.252623 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6a1ab2d5-f168-4617-a267-0be7bb276929 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:33.253632 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6a1ab2d5-f168-4617-a267-0be7bb276929 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:33.254178 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6a1ab2d5-f168-4617-a267-0be7bb276929 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:33.254859 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6a1ab2d5-f168-4617-a267-0be7bb276929 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:33.409321 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-6a1ab2d5-f168-4617-a267-0be7bb276929 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fbea2c71674b239e6d8fba6518e962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d9d02db5c49fda33321f2914a7f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:33.417577 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-6a1ab2d5-f168-4617-a267-0be7bb276929 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1" status: 200 len: 1361 microversion: 2.1 time: 0.184281 Aug 27 02:21:33.419876 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 56/100] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:33 2022] GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1 => generated 1361 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:21:33.537897 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-9bd84448-9e96-4848-8302-fc61fbb375ab tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:33.539412 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-9bd84448-9e96-4848-8302-fc61fbb375ab tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:33.555670 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9bd84448-9e96-4848-8302-fc61fbb375ab tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:33.556166 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9bd84448-9e96-4848-8302-fc61fbb375ab tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:33.556613 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9bd84448-9e96-4848-8302-fc61fbb375ab tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:33.557983 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9bd84448-9e96-4848-8302-fc61fbb375ab tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:33.558801 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9bd84448-9e96-4848-8302-fc61fbb375ab tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:33.559228 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9bd84448-9e96-4848-8302-fc61fbb375ab tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:33.583079 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:33.731806 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-9bd84448-9e96-4848-8302-fc61fbb375ab tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:33.733177 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-06390aca-4290-4746-9c47-fd591acef275 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:33.734451 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-06390aca-4290-4746-9c47-fd591acef275 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: 268d786c-398a-4305-85ac-545fa3b4370b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:33.741087 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-06390aca-4290-4746-9c47-fd591acef275 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:33.741849 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-06390aca-4290-4746-9c47-fd591acef275 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:33.742603 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-06390aca-4290-4746-9c47-fd591acef275 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:33.743658 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-06390aca-4290-4746-9c47-fd591acef275 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:33.744408 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-06390aca-4290-4746-9c47-fd591acef275 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:33.744976 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-06390aca-4290-4746-9c47-fd591acef275 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:33.748478 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-9bd84448-9e96-4848-8302-fc61fbb375ab tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:33.755007 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-9bd84448-9e96-4848-8302-fc61fbb375ab tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:33.756155 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-9bd84448-9e96-4848-8302-fc61fbb375ab tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db" status: 200 len: 1407 microversion: 2.20 time: 0.224010 Aug 27 02:21:33.770605 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 45/101] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:21:33 2022] GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db => generated 1407 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:21:33.806344 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [req-cd91c60e-954b-48bb-a534-d59d4b248bb0 req-3fe765b6-e630-4d1a-99f9-7c98f7b0dac7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47d706cc-4f9b-4d59-8eca-caae165ec5db", "name": "network-vif-plugged", "status": "completed", "tag": "118e8d55-f026-4cab-95af-2825721ac127"}]} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:21:33.831917 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-cd91c60e-954b-48bb-a534-d59d4b248bb0 req-3fe765b6-e630-4d1a-99f9-7c98f7b0dac7 service nova] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:33.832920 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-cd91c60e-954b-48bb-a534-d59d4b248bb0 req-3fe765b6-e630-4d1a-99f9-7c98f7b0dac7 service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:33.833618 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-cd91c60e-954b-48bb-a534-d59d4b248bb0 req-3fe765b6-e630-4d1a-99f9-7c98f7b0dac7 service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:33.869019 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.compute.server_external_events [req-cd91c60e-954b-48bb-a534-d59d4b248bb0 req-3fe765b6-e630-4d1a-99f9-7c98f7b0dac7 service nova] Creating event network-vif-plugged:118e8d55-f026-4cab-95af-2825721ac127 for instance 47d706cc-4f9b-4d59-8eca-caae165ec5db on hv-cinder-84630 Aug 27 02:21:33.879115 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [req-cd91c60e-954b-48bb-a534-d59d4b248bb0 req-3fe765b6-e630-4d1a-99f9-7c98f7b0dac7 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077334 Aug 27 02:21:33.881640 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 46/102] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Aug 27 02:21:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:21:33.998281 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-0064efef-c6c1-4208-8dca-003fc97ab927 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:34.000251 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-0064efef-c6c1-4208-8dca-003fc97ab927 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 5cbe7ad9-5124-4014-9d2a-e877493b2a9e] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:34.009241 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0064efef-c6c1-4208-8dca-003fc97ab927 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:34.009769 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0064efef-c6c1-4208-8dca-003fc97ab927 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:34.010464 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0064efef-c6c1-4208-8dca-003fc97ab927 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:34.011611 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0064efef-c6c1-4208-8dca-003fc97ab927 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:34.012387 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0064efef-c6c1-4208-8dca-003fc97ab927 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:34.013711 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0064efef-c6c1-4208-8dca-003fc97ab927 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:34.102233 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-06390aca-4290-4746-9c47-fd591acef275 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6f819365574091ae344f14e47f487f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa1c411b57d4e72885dac2b4f4dfe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:34.115318 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-06390aca-4290-4746-9c47-fd591acef275 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/268d786c-398a-4305-85ac-545fa3b4370b" status: 200 len: 1367 microversion: 2.1 time: 0.385673 Aug 27 02:21:34.116126 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 57/103] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:33 2022] GET /compute/v2.1/servers/268d786c-398a-4305-85ac-545fa3b4370b => generated 1367 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:21:34.192023 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-0064efef-c6c1-4208-8dca-003fc97ab927 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:34.201509 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-0064efef-c6c1-4208-8dca-003fc97ab927 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e" status: 200 len: 1322 microversion: 2.1 time: 0.215039 Aug 27 02:21:34.202170 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 47/104] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:33 2022] GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e => generated 1322 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:21:34.440513 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-b86501f2-77f9-4fe7-8dde-1f9cf3c2676f tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:34.441978 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-b86501f2-77f9-4fe7-8dde-1f9cf3c2676f tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 4fedf0d1-cc1c-4947-b92e-dcb4454889d1] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:34.450676 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b86501f2-77f9-4fe7-8dde-1f9cf3c2676f tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:34.451980 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b86501f2-77f9-4fe7-8dde-1f9cf3c2676f tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:34.452598 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b86501f2-77f9-4fe7-8dde-1f9cf3c2676f tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:34.453555 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b86501f2-77f9-4fe7-8dde-1f9cf3c2676f tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:34.455144 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b86501f2-77f9-4fe7-8dde-1f9cf3c2676f tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:34.455920 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b86501f2-77f9-4fe7-8dde-1f9cf3c2676f tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:34.651062 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-b86501f2-77f9-4fe7-8dde-1f9cf3c2676f tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fbea2c71674b239e6d8fba6518e962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d9d02db5c49fda33321f2914a7f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:34.660183 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-b86501f2-77f9-4fe7-8dde-1f9cf3c2676f tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1" status: 200 len: 1361 microversion: 2.1 time: 0.224813 Aug 27 02:21:34.661598 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 58/105] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:34 2022] GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1 => generated 1361 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:21:34.781754 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-de1a432d-386b-4b4c-8d04-da950f3004e3 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:34.783107 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-de1a432d-386b-4b4c-8d04-da950f3004e3 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:34.790113 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-de1a432d-386b-4b4c-8d04-da950f3004e3 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:34.790843 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-de1a432d-386b-4b4c-8d04-da950f3004e3 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:34.791420 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-de1a432d-386b-4b4c-8d04-da950f3004e3 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:34.792254 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-de1a432d-386b-4b4c-8d04-da950f3004e3 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:34.792986 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-de1a432d-386b-4b4c-8d04-da950f3004e3 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:34.793839 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-de1a432d-386b-4b4c-8d04-da950f3004e3 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:34.968616 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-de1a432d-386b-4b4c-8d04-da950f3004e3 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:34.978480 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-de1a432d-386b-4b4c-8d04-da950f3004e3 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:34.980301 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-de1a432d-386b-4b4c-8d04-da950f3004e3 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:34.981669 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-de1a432d-386b-4b4c-8d04-da950f3004e3 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db" status: 200 len: 1407 microversion: 2.20 time: 0.206363 Aug 27 02:21:34.982221 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 48/106] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:21:34 2022] GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db => generated 1407 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:21:35.138231 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-2f02d4a5-1d1c-4b57-9631-a583173ea968 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:35.139144 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-2f02d4a5-1d1c-4b57-9631-a583173ea968 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: 268d786c-398a-4305-85ac-545fa3b4370b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:35.150861 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2f02d4a5-1d1c-4b57-9631-a583173ea968 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:35.151669 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2f02d4a5-1d1c-4b57-9631-a583173ea968 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:35.152116 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2f02d4a5-1d1c-4b57-9631-a583173ea968 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:35.152992 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2f02d4a5-1d1c-4b57-9631-a583173ea968 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:35.153470 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2f02d4a5-1d1c-4b57-9631-a583173ea968 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:35.153936 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2f02d4a5-1d1c-4b57-9631-a583173ea968 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:35.235296 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-cd0fcdbc-6a2f-4965-89b5-584214e70f27 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:35.236559 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-cd0fcdbc-6a2f-4965-89b5-584214e70f27 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 5cbe7ad9-5124-4014-9d2a-e877493b2a9e] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:35.245074 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-cd0fcdbc-6a2f-4965-89b5-584214e70f27 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:35.245801 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-cd0fcdbc-6a2f-4965-89b5-584214e70f27 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:35.246413 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-cd0fcdbc-6a2f-4965-89b5-584214e70f27 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:35.247549 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-cd0fcdbc-6a2f-4965-89b5-584214e70f27 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:35.250584 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-cd0fcdbc-6a2f-4965-89b5-584214e70f27 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:35.253172 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-cd0fcdbc-6a2f-4965-89b5-584214e70f27 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:35.363857 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-2f02d4a5-1d1c-4b57-9631-a583173ea968 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6f819365574091ae344f14e47f487f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa1c411b57d4e72885dac2b4f4dfe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:35.377938 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-2f02d4a5-1d1c-4b57-9631-a583173ea968 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/268d786c-398a-4305-85ac-545fa3b4370b" status: 200 len: 1558 microversion: 2.1 time: 0.244924 Aug 27 02:21:35.378520 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 59/107] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:35 2022] GET /compute/v2.1/servers/268d786c-398a-4305-85ac-545fa3b4370b => generated 1558 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:21:35.399715 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-ebd87332-99cf-4ae3-9f84-6acb0a4de21a tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:35.400497 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-ebd87332-99cf-4ae3-9f84-6acb0a4de21a tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: 268d786c-398a-4305-85ac-545fa3b4370b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:35.407922 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ebd87332-99cf-4ae3-9f84-6acb0a4de21a tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:35.408491 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ebd87332-99cf-4ae3-9f84-6acb0a4de21a tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:35.409026 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ebd87332-99cf-4ae3-9f84-6acb0a4de21a tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:35.409830 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ebd87332-99cf-4ae3-9f84-6acb0a4de21a tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:35.410504 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ebd87332-99cf-4ae3-9f84-6acb0a4de21a tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:35.410991 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ebd87332-99cf-4ae3-9f84-6acb0a4de21a tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:35.459390 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-cd0fcdbc-6a2f-4965-89b5-584214e70f27 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:35.471018 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-cd0fcdbc-6a2f-4965-89b5-584214e70f27 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e" status: 200 len: 1516 microversion: 2.1 time: 0.240309 Aug 27 02:21:35.473475 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 49/108] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:35 2022] GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e => generated 1516 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:21:35.492507 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-6a820d06-65af-487d-bbd5-6c4037c739e4 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:21:35.495538 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-6a820d06-65af-487d-bbd5-6c4037c739e4 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 5cbe7ad9-5124-4014-9d2a-e877493b2a9e] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:35.503348 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6a820d06-65af-487d-bbd5-6c4037c739e4 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:35.504202 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6a820d06-65af-487d-bbd5-6c4037c739e4 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:35.504638 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6a820d06-65af-487d-bbd5-6c4037c739e4 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:35.505337 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6a820d06-65af-487d-bbd5-6c4037c739e4 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:35.506072 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6a820d06-65af-487d-bbd5-6c4037c739e4 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:35.506708 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6a820d06-65af-487d-bbd5-6c4037c739e4 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:35.530516 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-ebd87332-99cf-4ae3-9f84-6acb0a4de21a tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/268d786c-398a-4305-85ac-545fa3b4370b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.134229 Aug 27 02:21:35.531139 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.objects.instance [None req-6a820d06-65af-487d-bbd5-6c4037c739e4 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lazy-loading 'flavor' on Instance uuid 5cbe7ad9-5124-4014-9d2a-e877493b2a9e {{(pid=120783) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:21:35.538953 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 60/109] 10.222.0.61 () {58 vars in 1275 bytes} [Sat Aug 27 02:21:35 2022] GET /compute/v2.1/servers/268d786c-398a-4305-85ac-545fa3b4370b/os-interface => generated 285 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:21:35.672351 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-6a820d06-65af-487d-bbd5-6c4037c739e4 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "POST /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e/action" status: 200 len: 32 microversion: 2.1 time: 0.184327 Aug 27 02:21:35.673555 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 50/110] 10.222.0.61 () {60 vars in 1278 bytes} [Sat Aug 27 02:21:35 2022] POST /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e/action => generated 32 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:21:35.685227 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-916cbc8a-0acf-44ac-8e72-3e965d24138b tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:35.686419 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-916cbc8a-0acf-44ac-8e72-3e965d24138b tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 5cbe7ad9-5124-4014-9d2a-e877493b2a9e] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:35.688708 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:35.689190 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-963dc3dd-1fe8-438c-9ad9-1c73bf5319a3 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:35.689932 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-963dc3dd-1fe8-438c-9ad9-1c73bf5319a3 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 4fedf0d1-cc1c-4947-b92e-dcb4454889d1] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:35.697908 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-963dc3dd-1fe8-438c-9ad9-1c73bf5319a3 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:35.699125 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-963dc3dd-1fe8-438c-9ad9-1c73bf5319a3 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:35.699752 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-963dc3dd-1fe8-438c-9ad9-1c73bf5319a3 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:35.700068 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-916cbc8a-0acf-44ac-8e72-3e965d24138b tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:35.700797 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-916cbc8a-0acf-44ac-8e72-3e965d24138b tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:35.701035 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-963dc3dd-1fe8-438c-9ad9-1c73bf5319a3 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:35.701515 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-916cbc8a-0acf-44ac-8e72-3e965d24138b tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:35.701693 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-963dc3dd-1fe8-438c-9ad9-1c73bf5319a3 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:35.702297 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-963dc3dd-1fe8-438c-9ad9-1c73bf5319a3 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:35.703736 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-916cbc8a-0acf-44ac-8e72-3e965d24138b tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:35.704767 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-916cbc8a-0acf-44ac-8e72-3e965d24138b tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:35.705756 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-916cbc8a-0acf-44ac-8e72-3e965d24138b tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:35.861981 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-916cbc8a-0acf-44ac-8e72-3e965d24138b tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:35.875219 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-916cbc8a-0acf-44ac-8e72-3e965d24138b tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e" status: 200 len: 1522 microversion: 2.1 time: 0.194820 Aug 27 02:21:35.888986 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 61/111] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:35 2022] GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e => generated 1522 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:21:35.952558 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-963dc3dd-1fe8-438c-9ad9-1c73bf5319a3 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fbea2c71674b239e6d8fba6518e962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d9d02db5c49fda33321f2914a7f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:35.971293 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-963dc3dd-1fe8-438c-9ad9-1c73bf5319a3 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1" status: 200 len: 1361 microversion: 2.1 time: 0.285962 Aug 27 02:21:35.983253 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 51/112] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:35 2022] GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1 => generated 1361 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:21:36.009156 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-d60ff0b5-ca8a-41cc-a001-0a6b46b10ec8 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:36.009841 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-d60ff0b5-ca8a-41cc-a001-0a6b46b10ec8 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:36.022167 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d60ff0b5-ca8a-41cc-a001-0a6b46b10ec8 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:36.022886 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d60ff0b5-ca8a-41cc-a001-0a6b46b10ec8 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:36.023372 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d60ff0b5-ca8a-41cc-a001-0a6b46b10ec8 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:36.024265 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d60ff0b5-ca8a-41cc-a001-0a6b46b10ec8 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:36.024739 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d60ff0b5-ca8a-41cc-a001-0a6b46b10ec8 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:36.025428 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d60ff0b5-ca8a-41cc-a001-0a6b46b10ec8 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:36.187654 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-d60ff0b5-ca8a-41cc-a001-0a6b46b10ec8 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:36.201323 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-d60ff0b5-ca8a-41cc-a001-0a6b46b10ec8 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:36.205440 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-d60ff0b5-ca8a-41cc-a001-0a6b46b10ec8 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:36.205440 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-d60ff0b5-ca8a-41cc-a001-0a6b46b10ec8 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db" status: 200 len: 1407 microversion: 2.20 time: 0.200903 Aug 27 02:21:36.205440 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 62/113] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:21:36 2022] GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db => generated 1407 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:21:36.897301 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-fa64b3ce-a0bb-4d50-bee5-2e55c67e251b tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:36.898395 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-fa64b3ce-a0bb-4d50-bee5-2e55c67e251b tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 5cbe7ad9-5124-4014-9d2a-e877493b2a9e] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:36.906542 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fa64b3ce-a0bb-4d50-bee5-2e55c67e251b tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:36.907409 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fa64b3ce-a0bb-4d50-bee5-2e55c67e251b tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:36.908391 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fa64b3ce-a0bb-4d50-bee5-2e55c67e251b tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:36.909574 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fa64b3ce-a0bb-4d50-bee5-2e55c67e251b tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:36.910511 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fa64b3ce-a0bb-4d50-bee5-2e55c67e251b tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:36.911218 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fa64b3ce-a0bb-4d50-bee5-2e55c67e251b tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:36.996243 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-9d5daa73-fac4-4cc9-aa41-4f219cb2b6e9 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:36.997096 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-9d5daa73-fac4-4cc9-aa41-4f219cb2b6e9 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 4fedf0d1-cc1c-4947-b92e-dcb4454889d1] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:37.008146 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9d5daa73-fac4-4cc9-aa41-4f219cb2b6e9 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:37.009512 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9d5daa73-fac4-4cc9-aa41-4f219cb2b6e9 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:37.012566 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9d5daa73-fac4-4cc9-aa41-4f219cb2b6e9 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:37.014224 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9d5daa73-fac4-4cc9-aa41-4f219cb2b6e9 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:37.016324 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9d5daa73-fac4-4cc9-aa41-4f219cb2b6e9 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:37.018540 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9d5daa73-fac4-4cc9-aa41-4f219cb2b6e9 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:37.225263 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-fa64b3ce-a0bb-4d50-bee5-2e55c67e251b tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:37.239439 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-fa64b3ce-a0bb-4d50-bee5-2e55c67e251b tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e" status: 200 len: 1522 microversion: 2.1 time: 0.346906 Aug 27 02:21:37.240871 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 52/114] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:36 2022] GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e => generated 1522 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:21:37.246617 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-5ca09876-a8a0-4232-b42d-fc509e89afc6 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:37.247531 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-5ca09876-a8a0-4232-b42d-fc509e89afc6 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:37.253902 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5ca09876-a8a0-4232-b42d-fc509e89afc6 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:37.254720 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5ca09876-a8a0-4232-b42d-fc509e89afc6 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:37.255343 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5ca09876-a8a0-4232-b42d-fc509e89afc6 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:37.256240 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5ca09876-a8a0-4232-b42d-fc509e89afc6 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:37.256881 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5ca09876-a8a0-4232-b42d-fc509e89afc6 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:37.257560 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5ca09876-a8a0-4232-b42d-fc509e89afc6 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:37.350707 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-9d5daa73-fac4-4cc9-aa41-4f219cb2b6e9 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fbea2c71674b239e6d8fba6518e962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d9d02db5c49fda33321f2914a7f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:37.359937 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-9d5daa73-fac4-4cc9-aa41-4f219cb2b6e9 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1" status: 200 len: 1361 microversion: 2.1 time: 0.368232 Aug 27 02:21:37.360945 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 63/115] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:36 2022] GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1 => generated 1361 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:21:37.525962 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-5ca09876-a8a0-4232-b42d-fc509e89afc6 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:37.534652 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-5ca09876-a8a0-4232-b42d-fc509e89afc6 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:37.536761 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-5ca09876-a8a0-4232-b42d-fc509e89afc6 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:37.538047 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-5ca09876-a8a0-4232-b42d-fc509e89afc6 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db" status: 200 len: 1407 microversion: 2.20 time: 0.295769 Aug 27 02:21:37.539053 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 53/116] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:21:37 2022] GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db => generated 1407 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:21:37.629598 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [req-ab521bc7-419d-46c4-b0eb-296a7a18f33f req-ddab2821-b729-4e57-a842-6d8809c31a1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "268d786c-398a-4305-85ac-545fa3b4370b", "tag": "74ca1c59-a918-4f05-94e1-8a42c24359ab"}]} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:21:37.649342 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-ab521bc7-419d-46c4-b0eb-296a7a18f33f req-ddab2821-b729-4e57-a842-6d8809c31a1b service nova] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:37.651404 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-ab521bc7-419d-46c4-b0eb-296a7a18f33f req-ddab2821-b729-4e57-a842-6d8809c31a1b service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:37.652862 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-ab521bc7-419d-46c4-b0eb-296a7a18f33f req-ddab2821-b729-4e57-a842-6d8809c31a1b service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:37.671891 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.compute.server_external_events [req-ab521bc7-419d-46c4-b0eb-296a7a18f33f req-ddab2821-b729-4e57-a842-6d8809c31a1b service nova] Creating event network-changed:74ca1c59-a918-4f05-94e1-8a42c24359ab for instance 268d786c-398a-4305-85ac-545fa3b4370b on hv-cinder-84630 Aug 27 02:21:37.682056 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [req-ab521bc7-419d-46c4-b0eb-296a7a18f33f req-ddab2821-b729-4e57-a842-6d8809c31a1b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057800 Aug 27 02:21:37.683555 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 64/117] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Aug 27 02:21:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:21:38.269520 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-f8f963fc-d57e-4f1f-b4fc-40b7e669df96 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:38.274700 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-f8f963fc-d57e-4f1f-b4fc-40b7e669df96 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 5cbe7ad9-5124-4014-9d2a-e877493b2a9e] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:38.303969 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f8f963fc-d57e-4f1f-b4fc-40b7e669df96 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:38.307998 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f8f963fc-d57e-4f1f-b4fc-40b7e669df96 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:38.308877 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f8f963fc-d57e-4f1f-b4fc-40b7e669df96 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:38.311517 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f8f963fc-d57e-4f1f-b4fc-40b7e669df96 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:38.311984 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f8f963fc-d57e-4f1f-b4fc-40b7e669df96 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:38.312605 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f8f963fc-d57e-4f1f-b4fc-40b7e669df96 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:38.385486 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-e247540c-74e4-4aa3-9c74-b37e74d563fd tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:38.386731 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-e247540c-74e4-4aa3-9c74-b37e74d563fd tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 4fedf0d1-cc1c-4947-b92e-dcb4454889d1] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:38.396350 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e247540c-74e4-4aa3-9c74-b37e74d563fd tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:38.397300 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e247540c-74e4-4aa3-9c74-b37e74d563fd tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:38.398012 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e247540c-74e4-4aa3-9c74-b37e74d563fd tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:38.399555 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e247540c-74e4-4aa3-9c74-b37e74d563fd tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:38.400272 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e247540c-74e4-4aa3-9c74-b37e74d563fd tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:38.400902 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e247540c-74e4-4aa3-9c74-b37e74d563fd tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:38.660538 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-f8f963fc-d57e-4f1f-b4fc-40b7e669df96 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:38.678210 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-f8f963fc-d57e-4f1f-b4fc-40b7e669df96 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e" status: 200 len: 1522 microversion: 2.1 time: 0.418821 Aug 27 02:21:38.690773 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 54/118] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:38 2022] GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e => generated 1522 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:21:38.714750 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-105f5ca1-af0c-4135-95f4-899a76993576 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:38.717614 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-105f5ca1-af0c-4135-95f4-899a76993576 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:38.737753 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-105f5ca1-af0c-4135-95f4-899a76993576 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:38.739468 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-105f5ca1-af0c-4135-95f4-899a76993576 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:38.740983 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-105f5ca1-af0c-4135-95f4-899a76993576 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:38.742579 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-105f5ca1-af0c-4135-95f4-899a76993576 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:38.743521 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-105f5ca1-af0c-4135-95f4-899a76993576 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:38.744380 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-105f5ca1-af0c-4135-95f4-899a76993576 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:38.773872 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-e247540c-74e4-4aa3-9c74-b37e74d563fd tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fbea2c71674b239e6d8fba6518e962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d9d02db5c49fda33321f2914a7f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:38.783226 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-e247540c-74e4-4aa3-9c74-b37e74d563fd tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1" status: 200 len: 1361 microversion: 2.1 time: 0.403768 Aug 27 02:21:38.784325 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 65/119] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:38 2022] GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1 => generated 1361 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:21:38.971856 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-105f5ca1-af0c-4135-95f4-899a76993576 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:38.981138 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-105f5ca1-af0c-4135-95f4-899a76993576 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:38.982704 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-105f5ca1-af0c-4135-95f4-899a76993576 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:38.989876 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-105f5ca1-af0c-4135-95f4-899a76993576 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db" status: 200 len: 1407 microversion: 2.20 time: 0.297166 Aug 27 02:21:38.990494 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 55/120] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:21:38 2022] GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db => generated 1407 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:21:39.715923 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-bb1abe79-bfda-4e4b-8c45-be2a3a43834e tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:39.716448 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-bb1abe79-bfda-4e4b-8c45-be2a3a43834e tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 5cbe7ad9-5124-4014-9d2a-e877493b2a9e] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:39.734605 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-bb1abe79-bfda-4e4b-8c45-be2a3a43834e tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:39.735347 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-bb1abe79-bfda-4e4b-8c45-be2a3a43834e tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:39.735777 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-bb1abe79-bfda-4e4b-8c45-be2a3a43834e tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:39.736490 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-bb1abe79-bfda-4e4b-8c45-be2a3a43834e tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:39.736941 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-bb1abe79-bfda-4e4b-8c45-be2a3a43834e tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:39.738022 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-bb1abe79-bfda-4e4b-8c45-be2a3a43834e tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:39.820732 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-36b6c987-497e-4e62-ac75-0e5c875dc33f tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:39.821572 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-36b6c987-497e-4e62-ac75-0e5c875dc33f tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 4fedf0d1-cc1c-4947-b92e-dcb4454889d1] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:39.840013 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-36b6c987-497e-4e62-ac75-0e5c875dc33f tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:39.840856 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-36b6c987-497e-4e62-ac75-0e5c875dc33f tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:39.841738 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-36b6c987-497e-4e62-ac75-0e5c875dc33f tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:39.842802 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-36b6c987-497e-4e62-ac75-0e5c875dc33f tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:39.843511 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-36b6c987-497e-4e62-ac75-0e5c875dc33f tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:39.844226 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-36b6c987-497e-4e62-ac75-0e5c875dc33f tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:40.092041 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-36b6c987-497e-4e62-ac75-0e5c875dc33f tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fbea2c71674b239e6d8fba6518e962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d9d02db5c49fda33321f2914a7f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:40.101601 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-36b6c987-497e-4e62-ac75-0e5c875dc33f tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1" status: 200 len: 1361 microversion: 2.1 time: 0.284915 Aug 27 02:21:40.102982 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 56/121] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:39 2022] GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1 => generated 1361 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:21:40.114820 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-8c5ef460-dd37-402e-a4c7-f78523ef509a tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:40.115847 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-8c5ef460-dd37-402e-a4c7-f78523ef509a tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:40.125119 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8c5ef460-dd37-402e-a4c7-f78523ef509a tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:40.125784 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8c5ef460-dd37-402e-a4c7-f78523ef509a tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:40.126607 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8c5ef460-dd37-402e-a4c7-f78523ef509a tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:40.127424 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8c5ef460-dd37-402e-a4c7-f78523ef509a tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:40.127918 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8c5ef460-dd37-402e-a4c7-f78523ef509a tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:40.128433 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8c5ef460-dd37-402e-a4c7-f78523ef509a tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:40.322057 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-8c5ef460-dd37-402e-a4c7-f78523ef509a tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:40.333060 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-8c5ef460-dd37-402e-a4c7-f78523ef509a tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:40.338364 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-8c5ef460-dd37-402e-a4c7-f78523ef509a tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:40.343615 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-8c5ef460-dd37-402e-a4c7-f78523ef509a tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db" status: 200 len: 1599 microversion: 2.20 time: 0.237635 Aug 27 02:21:40.349537 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 57/122] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:21:40 2022] GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db => generated 1599 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:21:40.368983 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-dad4d77c-bc4f-4099-883a-d63650fb52f7 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:40.369508 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-dad4d77c-bc4f-4099-883a-d63650fb52f7 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:40.379075 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-dad4d77c-bc4f-4099-883a-d63650fb52f7 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:40.380040 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-dad4d77c-bc4f-4099-883a-d63650fb52f7 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:40.381300 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-dad4d77c-bc4f-4099-883a-d63650fb52f7 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:40.382262 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-dad4d77c-bc4f-4099-883a-d63650fb52f7 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:40.382911 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-dad4d77c-bc4f-4099-883a-d63650fb52f7 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:40.383518 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-dad4d77c-bc4f-4099-883a-d63650fb52f7 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:40.500057 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-dad4d77c-bc4f-4099-883a-d63650fb52f7 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.135710 Aug 27 02:21:40.501832 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 58/123] 10.222.0.61 () {60 vars in 1316 bytes} [Sat Aug 27 02:21:40 2022] GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db/os-interface => generated 284 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:21:40.550327 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-bb1abe79-bfda-4e4b-8c45-be2a3a43834e tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:40.560075 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-bb1abe79-bfda-4e4b-8c45-be2a3a43834e tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e" status: 200 len: 1522 microversion: 2.1 time: 0.848053 Aug 27 02:21:40.574655 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 66/124] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:39 2022] GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e => generated 1522 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:21:40.911740 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-48054591-9078-4c0d-8d65-12c2e393f053 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:40.913234 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-48054591-9078-4c0d-8d65-12c2e393f053 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] [instance: 2c255852-5b9e-4539-a1a1-502d5b6b30cb] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:40.921144 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-48054591-9078-4c0d-8d65-12c2e393f053 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:40.922291 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-48054591-9078-4c0d-8d65-12c2e393f053 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:40.922949 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-48054591-9078-4c0d-8d65-12c2e393f053 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:40.924154 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-48054591-9078-4c0d-8d65-12c2e393f053 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:40.926049 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-48054591-9078-4c0d-8d65-12c2e393f053 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:40.926705 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-48054591-9078-4c0d-8d65-12c2e393f053 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:40.962058 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-48054591-9078-4c0d-8d65-12c2e393f053 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] [instance: 2c255852-5b9e-4539-a1a1-502d5b6b30cb] Going to try to terminate instance {{(pid=120783) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:21:41.109087 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:41.122887 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-fe54656c-6057-4017-abac-a485d0932263 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:41.123497 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-fe54656c-6057-4017-abac-a485d0932263 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 4fedf0d1-cc1c-4947-b92e-dcb4454889d1] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:41.134339 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fe54656c-6057-4017-abac-a485d0932263 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:41.134836 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fe54656c-6057-4017-abac-a485d0932263 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:41.135262 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fe54656c-6057-4017-abac-a485d0932263 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:41.135969 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fe54656c-6057-4017-abac-a485d0932263 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:41.136417 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fe54656c-6057-4017-abac-a485d0932263 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:41.136835 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fe54656c-6057-4017-abac-a485d0932263 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:41.207330 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-48054591-9078-4c0d-8d65-12c2e393f053 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] 10.222.0.61 "DELETE /compute/v2.1/servers/2c255852-5b9e-4539-a1a1-502d5b6b30cb" status: 204 len: 0 microversion: 2.1 time: 0.300340 Aug 27 02:21:41.211763 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 59/125] 10.222.0.61 () {58 vars in 1239 bytes} [Sat Aug 27 02:21:40 2022] DELETE /compute/v2.1/servers/2c255852-5b9e-4539-a1a1-502d5b6b30cb => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:21:41.217900 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-67ec69af-7d17-4474-845d-8198af918686 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:41.218851 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-67ec69af-7d17-4474-845d-8198af918686 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] [instance: 2c255852-5b9e-4539-a1a1-502d5b6b30cb] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:41.227770 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-67ec69af-7d17-4474-845d-8198af918686 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:41.228377 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-67ec69af-7d17-4474-845d-8198af918686 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:41.229288 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-67ec69af-7d17-4474-845d-8198af918686 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:41.230247 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-67ec69af-7d17-4474-845d-8198af918686 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:41.230989 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-67ec69af-7d17-4474-845d-8198af918686 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:41.232596 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-67ec69af-7d17-4474-845d-8198af918686 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:41.568577 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-fe54656c-6057-4017-abac-a485d0932263 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fbea2c71674b239e6d8fba6518e962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d9d02db5c49fda33321f2914a7f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:41.586119 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-fe54656c-6057-4017-abac-a485d0932263 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1" status: 200 len: 1361 microversion: 2.1 time: 0.466870 Aug 27 02:21:41.590368 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 67/126] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:41 2022] GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1 => generated 1361 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:21:41.606936 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-b4bae49f-4753-4a0c-a898-3dda1aaebf9d tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:41.607906 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-b4bae49f-4753-4a0c-a898-3dda1aaebf9d tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 5cbe7ad9-5124-4014-9d2a-e877493b2a9e] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:41.622135 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b4bae49f-4753-4a0c-a898-3dda1aaebf9d tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:41.622624 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b4bae49f-4753-4a0c-a898-3dda1aaebf9d tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:41.623266 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b4bae49f-4753-4a0c-a898-3dda1aaebf9d tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:41.624075 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b4bae49f-4753-4a0c-a898-3dda1aaebf9d tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:41.624814 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b4bae49f-4753-4a0c-a898-3dda1aaebf9d tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:41.625473 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b4bae49f-4753-4a0c-a898-3dda1aaebf9d tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:41.792133 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-67ec69af-7d17-4474-845d-8198af918686 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fcf84d1b6d04255b62ab22d35e80280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29ac730884f411b91b8cb922f7b0bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:41.803768 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-67ec69af-7d17-4474-845d-8198af918686 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] 10.222.0.61 "GET /compute/v2.1/servers/2c255852-5b9e-4539-a1a1-502d5b6b30cb" status: 200 len: 1555 microversion: 2.1 time: 0.590368 Aug 27 02:21:41.804648 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 60/127] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:41 2022] GET /compute/v2.1/servers/2c255852-5b9e-4539-a1a1-502d5b6b30cb => generated 1555 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:21:41.927417 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-b4bae49f-4753-4a0c-a898-3dda1aaebf9d tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:41.940633 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-b4bae49f-4753-4a0c-a898-3dda1aaebf9d tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e" status: 200 len: 1522 microversion: 2.1 time: 0.343145 Aug 27 02:21:41.951739 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 68/128] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:41 2022] GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e => generated 1522 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:21:42.261332 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [req-1b36ee92-6546-4011-a055-7069cd1122d3 req-0e67920a-f15b-43fb-b272-db361b804904 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47d706cc-4f9b-4d59-8eca-caae165ec5db", "tag": "118e8d55-f026-4cab-95af-2825721ac127"}]} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:21:42.290496 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-1b36ee92-6546-4011-a055-7069cd1122d3 req-0e67920a-f15b-43fb-b272-db361b804904 service nova] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:42.294028 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-1b36ee92-6546-4011-a055-7069cd1122d3 req-0e67920a-f15b-43fb-b272-db361b804904 service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:42.295922 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-1b36ee92-6546-4011-a055-7069cd1122d3 req-0e67920a-f15b-43fb-b272-db361b804904 service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:42.334762 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.compute.server_external_events [req-1b36ee92-6546-4011-a055-7069cd1122d3 req-0e67920a-f15b-43fb-b272-db361b804904 service nova] Creating event network-changed:118e8d55-f026-4cab-95af-2825721ac127 for instance 47d706cc-4f9b-4d59-8eca-caae165ec5db on hv-cinder-84630 Aug 27 02:21:42.349005 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [req-1b36ee92-6546-4011-a055-7069cd1122d3 req-0e67920a-f15b-43fb-b272-db361b804904 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090468 Aug 27 02:21:42.351732 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 61/129] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Aug 27 02:21:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:21:42.526736 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [req-35c8b7f6-ad94-4247-88af-154f1ec87118 req-43319efa-e283-4893-aa07-6b8cc9281835 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fedf0d1-cc1c-4947-b92e-dcb4454889d1", "name": "network-vif-plugged", "status": "completed", "tag": "4bd07b6a-31ef-4e06-8c83-8a4ce8a68542"}]} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:21:42.562198 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-35c8b7f6-ad94-4247-88af-154f1ec87118 req-43319efa-e283-4893-aa07-6b8cc9281835 service nova] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:42.562698 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-35c8b7f6-ad94-4247-88af-154f1ec87118 req-43319efa-e283-4893-aa07-6b8cc9281835 service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:42.563419 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-35c8b7f6-ad94-4247-88af-154f1ec87118 req-43319efa-e283-4893-aa07-6b8cc9281835 service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:42.590647 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.compute.server_external_events [req-35c8b7f6-ad94-4247-88af-154f1ec87118 req-43319efa-e283-4893-aa07-6b8cc9281835 service nova] Creating event network-vif-plugged:4bd07b6a-31ef-4e06-8c83-8a4ce8a68542 for instance 4fedf0d1-cc1c-4947-b92e-dcb4454889d1 on hv-cinder-84630 Aug 27 02:21:42.604460 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [req-35c8b7f6-ad94-4247-88af-154f1ec87118 req-43319efa-e283-4893-aa07-6b8cc9281835 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081257 Aug 27 02:21:42.605766 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 69/130] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Aug 27 02:21:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:21:42.618144 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-4f49c1b9-f448-4dc6-9562-bb317f356d73 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:42.619233 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-4f49c1b9-f448-4dc6-9562-bb317f356d73 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 4fedf0d1-cc1c-4947-b92e-dcb4454889d1] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:42.632493 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4f49c1b9-f448-4dc6-9562-bb317f356d73 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:42.634161 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4f49c1b9-f448-4dc6-9562-bb317f356d73 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:42.634706 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4f49c1b9-f448-4dc6-9562-bb317f356d73 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:42.636362 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4f49c1b9-f448-4dc6-9562-bb317f356d73 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:42.638661 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4f49c1b9-f448-4dc6-9562-bb317f356d73 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:42.640300 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4f49c1b9-f448-4dc6-9562-bb317f356d73 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:42.827269 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-8a62c21a-fe17-4075-93ca-bc977f4a0761 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:42.828606 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-8a62c21a-fe17-4075-93ca-bc977f4a0761 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] [instance: 2c255852-5b9e-4539-a1a1-502d5b6b30cb] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:42.837191 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8a62c21a-fe17-4075-93ca-bc977f4a0761 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:42.837715 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8a62c21a-fe17-4075-93ca-bc977f4a0761 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:42.838148 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8a62c21a-fe17-4075-93ca-bc977f4a0761 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:42.845379 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8a62c21a-fe17-4075-93ca-bc977f4a0761 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:42.853868 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8a62c21a-fe17-4075-93ca-bc977f4a0761 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:42.854342 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8a62c21a-fe17-4075-93ca-bc977f4a0761 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:42.868914 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-4f49c1b9-f448-4dc6-9562-bb317f356d73 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fbea2c71674b239e6d8fba6518e962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d9d02db5c49fda33321f2914a7f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:42.913619 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-4f49c1b9-f448-4dc6-9562-bb317f356d73 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1" status: 200 len: 1361 microversion: 2.1 time: 0.300093 Aug 27 02:21:42.915185 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 62/131] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:42 2022] GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1 => generated 1361 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:21:42.928299 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell1:SELECT=100 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:42.962268 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-956873b6-8049-45ec-98de-e8a9b95b6289 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:42.963882 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-956873b6-8049-45ec-98de-e8a9b95b6289 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 5cbe7ad9-5124-4014-9d2a-e877493b2a9e] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:42.971692 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-956873b6-8049-45ec-98de-e8a9b95b6289 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:42.972537 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-956873b6-8049-45ec-98de-e8a9b95b6289 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:42.973185 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-956873b6-8049-45ec-98de-e8a9b95b6289 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:42.974685 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-956873b6-8049-45ec-98de-e8a9b95b6289 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:42.975388 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-956873b6-8049-45ec-98de-e8a9b95b6289 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:42.975885 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-956873b6-8049-45ec-98de-e8a9b95b6289 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:43.148677 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-8a62c21a-fe17-4075-93ca-bc977f4a0761 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fcf84d1b6d04255b62ab22d35e80280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29ac730884f411b91b8cb922f7b0bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:43.161718 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-8a62c21a-fe17-4075-93ca-bc977f4a0761 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] 10.222.0.61 "GET /compute/v2.1/servers/2c255852-5b9e-4539-a1a1-502d5b6b30cb" status: 200 len: 1555 microversion: 2.1 time: 0.339974 Aug 27 02:21:43.162167 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-956873b6-8049-45ec-98de-e8a9b95b6289 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:43.170531 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 70/132] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:42 2022] GET /compute/v2.1/servers/2c255852-5b9e-4539-a1a1-502d5b6b30cb => generated 1555 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:21:43.171745 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-956873b6-8049-45ec-98de-e8a9b95b6289 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e" status: 200 len: 1522 microversion: 2.1 time: 0.214355 Aug 27 02:21:43.187219 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 63/133] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:42 2022] GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e => generated 1522 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:21:43.935792 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-5c40ce2d-3fa6-423d-bdd1-53614f6f1950 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:43.936433 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-5c40ce2d-3fa6-423d-bdd1-53614f6f1950 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 4fedf0d1-cc1c-4947-b92e-dcb4454889d1] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:43.949503 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5c40ce2d-3fa6-423d-bdd1-53614f6f1950 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:43.950206 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5c40ce2d-3fa6-423d-bdd1-53614f6f1950 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:43.951224 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5c40ce2d-3fa6-423d-bdd1-53614f6f1950 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:43.952132 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5c40ce2d-3fa6-423d-bdd1-53614f6f1950 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:43.957068 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5c40ce2d-3fa6-423d-bdd1-53614f6f1950 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:43.957703 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5c40ce2d-3fa6-423d-bdd1-53614f6f1950 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:44.191824 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-b6a2d359-ca04-43ef-9757-94f0386a8ed8 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:44.193145 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-b6a2d359-ca04-43ef-9757-94f0386a8ed8 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] [instance: 2c255852-5b9e-4539-a1a1-502d5b6b30cb] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:44.203018 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b6a2d359-ca04-43ef-9757-94f0386a8ed8 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:44.203924 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b6a2d359-ca04-43ef-9757-94f0386a8ed8 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:44.204983 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b6a2d359-ca04-43ef-9757-94f0386a8ed8 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:44.208153 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b6a2d359-ca04-43ef-9757-94f0386a8ed8 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:44.210616 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b6a2d359-ca04-43ef-9757-94f0386a8ed8 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:44.211766 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b6a2d359-ca04-43ef-9757-94f0386a8ed8 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:44.404830 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-b6a2d359-ca04-43ef-9757-94f0386a8ed8 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fcf84d1b6d04255b62ab22d35e80280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29ac730884f411b91b8cb922f7b0bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:44.416170 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-b6a2d359-ca04-43ef-9757-94f0386a8ed8 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] 10.222.0.61 "GET /compute/v2.1/servers/2c255852-5b9e-4539-a1a1-502d5b6b30cb" status: 200 len: 1555 microversion: 2.1 time: 0.233294 Aug 27 02:21:44.418275 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 64/134] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:44 2022] GET /compute/v2.1/servers/2c255852-5b9e-4539-a1a1-502d5b6b30cb => generated 1555 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:21:44.424177 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-e6ac5c27-9345-4f16-b043-dbb9dedbea35 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:44.425453 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-e6ac5c27-9345-4f16-b043-dbb9dedbea35 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 5cbe7ad9-5124-4014-9d2a-e877493b2a9e] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:44.432669 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e6ac5c27-9345-4f16-b043-dbb9dedbea35 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:44.433588 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e6ac5c27-9345-4f16-b043-dbb9dedbea35 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:44.434222 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e6ac5c27-9345-4f16-b043-dbb9dedbea35 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:44.435415 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e6ac5c27-9345-4f16-b043-dbb9dedbea35 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:44.436077 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e6ac5c27-9345-4f16-b043-dbb9dedbea35 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:44.436643 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e6ac5c27-9345-4f16-b043-dbb9dedbea35 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:44.484375 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-5c40ce2d-3fa6-423d-bdd1-53614f6f1950 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fbea2c71674b239e6d8fba6518e962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d9d02db5c49fda33321f2914a7f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:44.493291 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-5c40ce2d-3fa6-423d-bdd1-53614f6f1950 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1" status: 200 len: 1361 microversion: 2.1 time: 0.561341 Aug 27 02:21:44.498254 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 71/135] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:43 2022] GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1 => generated 1361 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:21:44.657838 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-e6ac5c27-9345-4f16-b043-dbb9dedbea35 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:44.667852 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-e6ac5c27-9345-4f16-b043-dbb9dedbea35 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e" status: 200 len: 1522 microversion: 2.1 time: 0.247563 Aug 27 02:21:44.668901 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 65/136] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:44 2022] GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e => generated 1522 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:21:45.405143 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [req-c940fa9f-aad8-4fa8-88f1-41fd12bf2253 req-b6299123-3ab2-413d-9544-49b2cf9eab36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c255852-5b9e-4539-a1a1-502d5b6b30cb", "name": "network-vif-deleted", "tag": "a1b63727-ff86-45bf-bd1a-b38a61c8d845"}]} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:21:45.416966 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-c940fa9f-aad8-4fa8-88f1-41fd12bf2253 req-b6299123-3ab2-413d-9544-49b2cf9eab36 service nova] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:45.417748 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-c940fa9f-aad8-4fa8-88f1-41fd12bf2253 req-b6299123-3ab2-413d-9544-49b2cf9eab36 service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:45.418186 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-c940fa9f-aad8-4fa8-88f1-41fd12bf2253 req-b6299123-3ab2-413d-9544-49b2cf9eab36 service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:45.438504 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-3230fb08-4382-4e69-b133-26aa7818a0bd tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:45.448455 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.compute.server_external_events [req-c940fa9f-aad8-4fa8-88f1-41fd12bf2253 req-b6299123-3ab2-413d-9544-49b2cf9eab36 service nova] Creating event network-vif-deleted:a1b63727-ff86-45bf-bd1a-b38a61c8d845 for instance 2c255852-5b9e-4539-a1a1-502d5b6b30cb on hv-cinder-84630 Aug 27 02:21:45.449094 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-3230fb08-4382-4e69-b133-26aa7818a0bd tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] [instance: 2c255852-5b9e-4539-a1a1-502d5b6b30cb] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:45.455495 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [req-c940fa9f-aad8-4fa8-88f1-41fd12bf2253 req-b6299123-3ab2-413d-9544-49b2cf9eab36 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055165 Aug 27 02:21:45.457047 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 72/137] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Aug 27 02:21:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:21:45.471891 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3230fb08-4382-4e69-b133-26aa7818a0bd tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:45.476834 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3230fb08-4382-4e69-b133-26aa7818a0bd tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:45.479059 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3230fb08-4382-4e69-b133-26aa7818a0bd tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:45.480664 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3230fb08-4382-4e69-b133-26aa7818a0bd tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:45.481316 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3230fb08-4382-4e69-b133-26aa7818a0bd tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:45.481923 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3230fb08-4382-4e69-b133-26aa7818a0bd tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:45.526160 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-d5158991-c28d-4ea8-8fee-ccd9549b14c6 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:45.527622 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-d5158991-c28d-4ea8-8fee-ccd9549b14c6 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 4fedf0d1-cc1c-4947-b92e-dcb4454889d1] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:45.535661 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d5158991-c28d-4ea8-8fee-ccd9549b14c6 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:45.536946 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d5158991-c28d-4ea8-8fee-ccd9549b14c6 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:45.537755 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d5158991-c28d-4ea8-8fee-ccd9549b14c6 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:45.538868 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d5158991-c28d-4ea8-8fee-ccd9549b14c6 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:45.539684 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d5158991-c28d-4ea8-8fee-ccd9549b14c6 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:45.540716 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d5158991-c28d-4ea8-8fee-ccd9549b14c6 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:45.611550 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-3230fb08-4382-4e69-b133-26aa7818a0bd tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fcf84d1b6d04255b62ab22d35e80280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29ac730884f411b91b8cb922f7b0bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:45.621482 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-3230fb08-4382-4e69-b133-26aa7818a0bd tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] 10.222.0.61 "GET /compute/v2.1/servers/2c255852-5b9e-4539-a1a1-502d5b6b30cb" status: 200 len: 1513 microversion: 2.1 time: 0.187140 Aug 27 02:21:45.622325 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 66/138] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:45 2022] GET /compute/v2.1/servers/2c255852-5b9e-4539-a1a1-502d5b6b30cb => generated 1513 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:21:45.696342 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-aafe82d6-8e41-4891-a247-c0e181dbf00d tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:45.696956 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-aafe82d6-8e41-4891-a247-c0e181dbf00d tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 5cbe7ad9-5124-4014-9d2a-e877493b2a9e] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:45.703798 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-aafe82d6-8e41-4891-a247-c0e181dbf00d tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:45.704283 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-aafe82d6-8e41-4891-a247-c0e181dbf00d tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:45.705448 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-aafe82d6-8e41-4891-a247-c0e181dbf00d tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:45.706817 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-aafe82d6-8e41-4891-a247-c0e181dbf00d tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:45.707430 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-aafe82d6-8e41-4891-a247-c0e181dbf00d tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:45.708248 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-aafe82d6-8e41-4891-a247-c0e181dbf00d tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:45.754492 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-d5158991-c28d-4ea8-8fee-ccd9549b14c6 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fbea2c71674b239e6d8fba6518e962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d9d02db5c49fda33321f2914a7f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:45.768049 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-d5158991-c28d-4ea8-8fee-ccd9549b14c6 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1" status: 200 len: 1361 microversion: 2.1 time: 0.246768 Aug 27 02:21:45.771344 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 73/139] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:45 2022] GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1 => generated 1361 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:21:45.910626 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-aafe82d6-8e41-4891-a247-c0e181dbf00d tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:45.919401 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-aafe82d6-8e41-4891-a247-c0e181dbf00d tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e" status: 200 len: 1522 microversion: 2.1 time: 0.227465 Aug 27 02:21:45.921057 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 67/140] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:45 2022] GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e => generated 1522 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:21:46.187716 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-80e238a3-db92-4e24-b4e8-6e035583ab9c tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-43751759", "imageRef": "7d45cdd6-750f-40c7-9475-f7bf12fcb204", "flavorRef": "452", "networks": [{"uuid": "4a3f0af2-7aa7-4287-9a15-90463c51effb"}]}} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:21:46.263665 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.network.neutron [None req-80e238a3-db92-4e24-b4e8-6e035583ab9c tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] validate_networks() for [('4a3f0af2-7aa7-4287-9a15-90463c51effb', None, None, None, None, None)] {{(pid=120782) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:21:46.646447 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-8a9c3c02-c4d5-4fc0-b1cc-ee33ba003eb3 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:46.647788 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-8a9c3c02-c4d5-4fc0-b1cc-ee33ba003eb3 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] [instance: 2c255852-5b9e-4539-a1a1-502d5b6b30cb] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:46.655790 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8a9c3c02-c4d5-4fc0-b1cc-ee33ba003eb3 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:46.656743 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8a9c3c02-c4d5-4fc0-b1cc-ee33ba003eb3 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:46.657372 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8a9c3c02-c4d5-4fc0-b1cc-ee33ba003eb3 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:46.658516 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8a9c3c02-c4d5-4fc0-b1cc-ee33ba003eb3 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:46.659130 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8a9c3c02-c4d5-4fc0-b1cc-ee33ba003eb3 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:46.659731 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8a9c3c02-c4d5-4fc0-b1cc-ee33ba003eb3 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:46.708727 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8a9c3c02-c4d5-4fc0-b1cc-ee33ba003eb3 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:46.709208 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8a9c3c02-c4d5-4fc0-b1cc-ee33ba003eb3 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:46.709668 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8a9c3c02-c4d5-4fc0-b1cc-ee33ba003eb3 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:46.710111 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.objects.instance [None req-8a9c3c02-c4d5-4fc0-b1cc-ee33ba003eb3 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lazy-loading 'fault' on Instance uuid 2c255852-5b9e-4539-a1a1-502d5b6b30cb {{(pid=120783) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:21:46.781783 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-8a9c3c02-c4d5-4fc0-b1cc-ee33ba003eb3 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fcf84d1b6d04255b62ab22d35e80280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29ac730884f411b91b8cb922f7b0bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:46.792031 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-8a9c3c02-c4d5-4fc0-b1cc-ee33ba003eb3 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] 10.222.0.61 "GET /compute/v2.1/servers/2c255852-5b9e-4539-a1a1-502d5b6b30cb" status: 200 len: 1351 microversion: 2.1 time: 0.149992 Aug 27 02:21:46.792599 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 68/141] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:46 2022] GET /compute/v2.1/servers/2c255852-5b9e-4539-a1a1-502d5b6b30cb => generated 1351 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:21:46.798383 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-83e403b2-8f5a-4a95-bd6a-b0d8bdaf8e7c tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:46.799250 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-83e403b2-8f5a-4a95-bd6a-b0d8bdaf8e7c tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 4fedf0d1-cc1c-4947-b92e-dcb4454889d1] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:46.814705 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-83e403b2-8f5a-4a95-bd6a-b0d8bdaf8e7c tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:46.816094 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-83e403b2-8f5a-4a95-bd6a-b0d8bdaf8e7c tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:46.817042 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-83e403b2-8f5a-4a95-bd6a-b0d8bdaf8e7c tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:46.819797 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-83e403b2-8f5a-4a95-bd6a-b0d8bdaf8e7c tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:46.820869 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-83e403b2-8f5a-4a95-bd6a-b0d8bdaf8e7c tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:46.822076 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-83e403b2-8f5a-4a95-bd6a-b0d8bdaf8e7c tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:46.936096 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-80e238a3-db92-4e24-b4e8-6e035583ab9c tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Flavor limits 0:0:0 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:21:46.937084 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-80e238a3-db92-4e24-b4e8-6e035583ab9c tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Image limits 0:0:0 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:21:46.939753 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-80e238a3-db92-4e24-b4e8-6e035583ab9c tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Flavor pref 0:0:0 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:21:46.940368 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-80e238a3-db92-4e24-b4e8-6e035583ab9c tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Image pref 0:0:0 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:21:46.941019 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-80e238a3-db92-4e24-b4e8-6e035583ab9c tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:21:46.970545 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-80e238a3-db92-4e24-b4e8-6e035583ab9c tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:46.971380 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-80e238a3-db92-4e24-b4e8-6e035583ab9c tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:46.972320 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-80e238a3-db92-4e24-b4e8-6e035583ab9c tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:46.973423 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-80e238a3-db92-4e24-b4e8-6e035583ab9c tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:46.974491 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-80e238a3-db92-4e24-b4e8-6e035583ab9c tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:46.975078 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-80e238a3-db92-4e24-b4e8-6e035583ab9c tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:47.005366 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.quota [None req-80e238a3-db92-4e24-b4e8-6e035583ab9c tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Getting quotas for project bcc715590f88432d9b6e7dd779ad5851. Resources: {'instances', 'ram', 'cores'} {{(pid=120782) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:21:47.010537 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.quota [None req-80e238a3-db92-4e24-b4e8-6e035583ab9c tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Getting quotas for user 1bc3be23405d4ae88dd46d656ad6a3c8 and project bcc715590f88432d9b6e7dd779ad5851. Resources: {'instances', 'ram', 'cores'} {{(pid=120782) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:21:47.023251 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-80e238a3-db92-4e24-b4e8-6e035583ab9c tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Going to run 1 instances... {{(pid=120782) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:21:47.025848 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-80e238a3-db92-4e24-b4e8-6e035583ab9c tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] [instance: 6dffef84-3605-422f-ac42-8c1614b24539] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7d45cdd6-750f-40c7-9475-f7bf12fcb204',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120782) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:21:47.081689 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-80e238a3-db92-4e24-b4e8-6e035583ab9c tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.241376 Aug 27 02:21:47.082839 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 74/142] 10.222.0.61 () {60 vars in 1147 bytes} [Sat Aug 27 02:21:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1244 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 02:21:47.084688 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-83e403b2-8f5a-4a95-bd6a-b0d8bdaf8e7c tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fbea2c71674b239e6d8fba6518e962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d9d02db5c49fda33321f2914a7f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:47.093753 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-9a74cc29-a7c5-49b4-b795-f9c13e440867 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:47.094830 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-9a74cc29-a7c5-49b4-b795-f9c13e440867 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 5cbe7ad9-5124-4014-9d2a-e877493b2a9e] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:47.102897 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-83e403b2-8f5a-4a95-bd6a-b0d8bdaf8e7c tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1" status: 200 len: 1546 microversion: 2.1 time: 0.308573 Aug 27 02:21:47.103286 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9a74cc29-a7c5-49b4-b795-f9c13e440867 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:47.103729 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9a74cc29-a7c5-49b4-b795-f9c13e440867 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:47.104167 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9a74cc29-a7c5-49b4-b795-f9c13e440867 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:47.104888 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9a74cc29-a7c5-49b4-b795-f9c13e440867 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:47.105342 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9a74cc29-a7c5-49b4-b795-f9c13e440867 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:47.106684 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9a74cc29-a7c5-49b4-b795-f9c13e440867 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:47.106862 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 69/143] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:46 2022] GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1 => generated 1546 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:21:47.132924 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-98f9eccd-a767-46ed-a4ff-058310048dd2 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:47.136036 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-98f9eccd-a767-46ed-a4ff-058310048dd2 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] [instance: 6dffef84-3605-422f-ac42-8c1614b24539] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:47.363665 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-98f9eccd-a767-46ed-a4ff-058310048dd2 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc3be23405d4ae88dd46d656ad6a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc715590f88432d9b6e7dd779ad5851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:47.377584 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-98f9eccd-a767-46ed-a4ff-058310048dd2 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] 10.222.0.61 "GET /compute/v2.1/servers/6dffef84-3605-422f-ac42-8c1614b24539" status: 200 len: 1212 microversion: 2.1 time: 0.266506 Aug 27 02:21:47.394056 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 70/144] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:47 2022] GET /compute/v2.1/servers/6dffef84-3605-422f-ac42-8c1614b24539 => generated 1212 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:21:47.408850 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-3fd0fdcc-b985-4f06-91c0-74c3cf703b92 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:47.409564 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-3fd0fdcc-b985-4f06-91c0-74c3cf703b92 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 4fedf0d1-cc1c-4947-b92e-dcb4454889d1] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:47.415227 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:47.422641 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3fd0fdcc-b985-4f06-91c0-74c3cf703b92 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:47.423495 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3fd0fdcc-b985-4f06-91c0-74c3cf703b92 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:47.424350 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3fd0fdcc-b985-4f06-91c0-74c3cf703b92 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:47.425780 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3fd0fdcc-b985-4f06-91c0-74c3cf703b92 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:47.427065 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3fd0fdcc-b985-4f06-91c0-74c3cf703b92 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:47.428051 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3fd0fdcc-b985-4f06-91c0-74c3cf703b92 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:47.473412 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-9a74cc29-a7c5-49b4-b795-f9c13e440867 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:47.485906 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-9a74cc29-a7c5-49b4-b795-f9c13e440867 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e" status: 200 len: 1522 microversion: 2.1 time: 0.401565 Aug 27 02:21:47.487782 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 75/145] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:47 2022] GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e => generated 1522 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:21:47.560580 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-3fd0fdcc-b985-4f06-91c0-74c3cf703b92 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.167480 Aug 27 02:21:47.562120 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 71/146] 10.222.0.61 () {58 vars in 1275 bytes} [Sat Aug 27 02:21:47 2022] GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1/os-interface => generated 284 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:21:47.814173 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-d8683cd8-a854-469e-b8ed-b8f0104ca641 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:47.814808 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-d8683cd8-a854-469e-b8ed-b8f0104ca641 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] [instance: 2c255852-5b9e-4539-a1a1-502d5b6b30cb] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:47.821935 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d8683cd8-a854-469e-b8ed-b8f0104ca641 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:47.822426 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d8683cd8-a854-469e-b8ed-b8f0104ca641 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:47.822975 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d8683cd8-a854-469e-b8ed-b8f0104ca641 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:47.823585 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d8683cd8-a854-469e-b8ed-b8f0104ca641 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:47.824060 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d8683cd8-a854-469e-b8ed-b8f0104ca641 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:47.824487 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d8683cd8-a854-469e-b8ed-b8f0104ca641 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:47.856798 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d8683cd8-a854-469e-b8ed-b8f0104ca641 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:47.857342 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d8683cd8-a854-469e-b8ed-b8f0104ca641 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:47.857803 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d8683cd8-a854-469e-b8ed-b8f0104ca641 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:47.858263 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.objects.instance [None req-d8683cd8-a854-469e-b8ed-b8f0104ca641 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lazy-loading 'fault' on Instance uuid 2c255852-5b9e-4539-a1a1-502d5b6b30cb {{(pid=120782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:21:47.956537 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-d8683cd8-a854-469e-b8ed-b8f0104ca641 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fcf84d1b6d04255b62ab22d35e80280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29ac730884f411b91b8cb922f7b0bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:47.967184 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-d8683cd8-a854-469e-b8ed-b8f0104ca641 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] 10.222.0.61 "GET /compute/v2.1/servers/2c255852-5b9e-4539-a1a1-502d5b6b30cb" status: 200 len: 1351 microversion: 2.1 time: 0.156848 Aug 27 02:21:47.967894 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 76/147] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:47 2022] GET /compute/v2.1/servers/2c255852-5b9e-4539-a1a1-502d5b6b30cb => generated 1351 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:21:48.403582 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-480be458-5da1-430e-840f-57d10b6dcc55 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:48.412805 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-480be458-5da1-430e-840f-57d10b6dcc55 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] [instance: 6dffef84-3605-422f-ac42-8c1614b24539] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:48.423811 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-480be458-5da1-430e-840f-57d10b6dcc55 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:48.424692 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-480be458-5da1-430e-840f-57d10b6dcc55 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:48.426401 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-480be458-5da1-430e-840f-57d10b6dcc55 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:48.428056 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-480be458-5da1-430e-840f-57d10b6dcc55 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:48.430374 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-480be458-5da1-430e-840f-57d10b6dcc55 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:48.431288 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-480be458-5da1-430e-840f-57d10b6dcc55 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:48.508208 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-e5725448-0028-440a-be0d-04b96701dfa3 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:48.508819 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-e5725448-0028-440a-be0d-04b96701dfa3 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 5cbe7ad9-5124-4014-9d2a-e877493b2a9e] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:48.518173 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e5725448-0028-440a-be0d-04b96701dfa3 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:48.518657 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e5725448-0028-440a-be0d-04b96701dfa3 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:48.519087 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e5725448-0028-440a-be0d-04b96701dfa3 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:48.522692 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e5725448-0028-440a-be0d-04b96701dfa3 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:48.525446 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e5725448-0028-440a-be0d-04b96701dfa3 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:48.527822 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e5725448-0028-440a-be0d-04b96701dfa3 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:48.560620 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-480be458-5da1-430e-840f-57d10b6dcc55 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc3be23405d4ae88dd46d656ad6a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc715590f88432d9b6e7dd779ad5851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:48.576133 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-480be458-5da1-430e-840f-57d10b6dcc55 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] 10.222.0.61 "GET /compute/v2.1/servers/6dffef84-3605-422f-ac42-8c1614b24539" status: 200 len: 1264 microversion: 2.1 time: 0.177382 Aug 27 02:21:48.577430 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 72/148] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:48 2022] GET /compute/v2.1/servers/6dffef84-3605-422f-ac42-8c1614b24539 => generated 1264 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:21:48.694625 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-f286c9b5-9c94-429d-9649-3bbf35eee0cf tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1433740629", "imageRef": "7d45cdd6-750f-40c7-9475-f7bf12fcb204", "flavorRef": "452"}} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:21:48.786539 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.network.neutron [None req-f286c9b5-9c94-429d-9649-3bbf35eee0cf tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] validate_networks() for None {{(pid=120783) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:21:48.972819 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-e5725448-0028-440a-be0d-04b96701dfa3 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:48.995559 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-e5725448-0028-440a-be0d-04b96701dfa3 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e" status: 200 len: 1522 microversion: 2.1 time: 0.489571 Aug 27 02:21:48.997078 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 77/149] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:48 2022] GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e => generated 1522 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:21:49.009914 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-3ec1d7ed-6715-4440-82a9-720ba3de9d10 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:49.011164 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-3ec1d7ed-6715-4440-82a9-720ba3de9d10 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] [instance: 2c255852-5b9e-4539-a1a1-502d5b6b30cb] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:49.020630 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3ec1d7ed-6715-4440-82a9-720ba3de9d10 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:49.021317 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3ec1d7ed-6715-4440-82a9-720ba3de9d10 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:49.022185 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3ec1d7ed-6715-4440-82a9-720ba3de9d10 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:49.023279 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3ec1d7ed-6715-4440-82a9-720ba3de9d10 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:49.023734 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3ec1d7ed-6715-4440-82a9-720ba3de9d10 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:49.024147 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3ec1d7ed-6715-4440-82a9-720ba3de9d10 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:49.060581 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.wsgi [None req-3ec1d7ed-6715-4440-82a9-720ba3de9d10 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] HTTP exception thrown: Instance 2c255852-5b9e-4539-a1a1-502d5b6b30cb could not be found. Aug 27 02:21:49.070856 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-3ec1d7ed-6715-4440-82a9-720ba3de9d10 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Request method failure captured: Aug 27 02:21:49.070856 dv-cinder-846303-3-smb devstack@n-api.service[120782]: request: GET /compute/v2.1/servers/2c255852-5b9e-4539-a1a1-502d5b6b30cb HTTP/1.1 Aug 27 02:21:49.070856 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Accept: application/json Aug 27 02:21:49.070856 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Accept-Encoding: identity Aug 27 02:21:49.070856 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Connection: close Aug 27 02:21:49.070856 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Content-Length: 0 Aug 27 02:21:49.070856 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Content-Type: application/json Aug 27 02:21:49.070856 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Host: 10.222.0.61 Aug 27 02:21:49.070856 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Openstack-System-Scope: None Aug 27 02:21:49.070856 dv-cinder-846303-3-smb devstack@n-api.service[120782]: User-Agent: python-urllib3/1.26.11 Aug 27 02:21:49.070856 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Auth-Token: gAAAAABjCX-Irp2pww3S-zCGxs79mH2yytVVwSDkVco1hCiNyqNYVTsaCfe5ar9lnku62Iksgcy8jxBVZm0TOfNKTbJjvFa7uiHF-lPlh_plkoKuN3Ef4_A4ODpDLxpr5DSVVI3xPlDW7szicrQVC0Wa1_lxmRy2HAUDwhn2f86kj_Lx_jYZcQo Aug 27 02:21:49.070856 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Domain-Id: None Aug 27 02:21:49.070856 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Domain-Name: None Aug 27 02:21:49.070856 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Identity-Status: Confirmed Aug 27 02:21:49.070856 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Is-Admin-Project: True Aug 27 02:21:49.070856 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Domain-Id: default Aug 27 02:21:49.070856 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Domain-Name: Default Aug 27 02:21:49.070856 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Id: b29ac730884f411b91b8cb922f7b0bea Aug 27 02:21:49.070856 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Name: tempest-DeleteServersTestJSON-814860316 Aug 27 02:21:49.070856 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Role: member,reader Aug 27 02:21:49.070856 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Roles: member,reader Aug 27 02:21:49.072246 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/b29ac730884f411b91b8cb922f7b0bea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_b29ac730884f411b91b8cb922f7b0bea", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b29ac730884f411b91b8cb922f7b0bea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b29ac730884f411b91b8cb922f7b0bea"}]}] Aug 27 02:21:49.072246 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Tenant: tempest-DeleteServersTestJSON-814860316 Aug 27 02:21:49.072246 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Tenant-Id: b29ac730884f411b91b8cb922f7b0bea Aug 27 02:21:49.072246 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Tenant-Name: tempest-DeleteServersTestJSON-814860316 Aug 27 02:21:49.072246 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User: tempest-DeleteServersTestJSON-814860316-project Aug 27 02:21:49.072246 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Domain-Id: default Aug 27 02:21:49.072246 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Domain-Name: Default Aug 27 02:21:49.072246 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Id: 8fcf84d1b6d04255b62ab22d35e80280 Aug 27 02:21:49.072246 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Name: tempest-DeleteServersTestJSON-814860316-project Aug 27 02:21:49.072246 dv-cinder-846303-3-smb devstack@n-api.service[120782]: method: > Aug 27 02:21:49.072246 dv-cinder-846303-3-smb devstack@n-api.service[120782]: exception: Instance 2c255852-5b9e-4539-a1a1-502d5b6b30cb could not be found. Aug 27 02:21:49.072246 dv-cinder-846303-3-smb devstack@n-api.service[120782]: action_args: {'id': '2c255852-5b9e-4539-a1a1-502d5b6b30cb'} Aug 27 02:21:49.072933 dv-cinder-846303-3-smb devstack@n-api.service[120782]: {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:21:49.072933 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:21:49.072933 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:21:49.072933 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:21:49.072933 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:21:49.072933 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:21:49.072933 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:21:49.072933 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:21:49.072933 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:21:49.072933 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:21:49.072933 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c255852-5b9e-4539-a1a1-502d5b6b30cb could not be found. Aug 27 02:21:49.072933 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:21:49.072933 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:21:49.072933 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:21:49.072933 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:21:49.072933 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:21:49.072933 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:21:49.072933 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:21:49.072933 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:21:49.072933 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:21:49.074118 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:21:49.074118 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:21:49.074118 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:21:49.074118 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:21:49.074118 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:21:49.074118 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:21:49.074118 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:21:49.074118 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c255852-5b9e-4539-a1a1-502d5b6b30cb could not be found. Aug 27 02:21:49.074118 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:21:49.074118 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:21:49.074118 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:21:49.074118 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:21:49.074118 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:21:49.074118 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:21:49.074118 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:21:49.074118 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:21:49.074118 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c255852-5b9e-4539-a1a1-502d5b6b30cb could not be found. Aug 27 02:21:49.074118 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:21:49.077086 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-3ec1d7ed-6715-4440-82a9-720ba3de9d10 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Returning 404 to user: Instance 2c255852-5b9e-4539-a1a1-502d5b6b30cb could not be found. {{(pid=120782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:21:49.077086 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-3ec1d7ed-6715-4440-82a9-720ba3de9d10 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] 10.222.0.61 "GET /compute/v2.1/servers/2c255852-5b9e-4539-a1a1-502d5b6b30cb" status: 404 len: 111 microversion: 2.1 time: 0.074052 Aug 27 02:21:49.077086 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 78/150] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:48 2022] GET /compute/v2.1/servers/2c255852-5b9e-4539-a1a1-502d5b6b30cb => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:21:49.193183 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.virt.hardware [None req-f286c9b5-9c94-429d-9649-3bbf35eee0cf tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Flavor limits 0:0:0 {{(pid=120783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:21:49.193632 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.virt.hardware [None req-f286c9b5-9c94-429d-9649-3bbf35eee0cf tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Image limits 0:0:0 {{(pid=120783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:21:49.194100 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.virt.hardware [None req-f286c9b5-9c94-429d-9649-3bbf35eee0cf tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Flavor pref 0:0:0 {{(pid=120783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:21:49.194499 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.virt.hardware [None req-f286c9b5-9c94-429d-9649-3bbf35eee0cf tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Image pref 0:0:0 {{(pid=120783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:21:49.195192 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.virt.hardware [None req-f286c9b5-9c94-429d-9649-3bbf35eee0cf tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:21:49.205957 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f286c9b5-9c94-429d-9649-3bbf35eee0cf tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:49.206495 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f286c9b5-9c94-429d-9649-3bbf35eee0cf tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:49.206857 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f286c9b5-9c94-429d-9649-3bbf35eee0cf tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:49.208018 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f286c9b5-9c94-429d-9649-3bbf35eee0cf tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:49.208684 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f286c9b5-9c94-429d-9649-3bbf35eee0cf tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:49.209106 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f286c9b5-9c94-429d-9649-3bbf35eee0cf tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:49.229877 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.quota [None req-f286c9b5-9c94-429d-9649-3bbf35eee0cf tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Getting quotas for project 74107e05cf1644fc805625368fca2cbb. Resources: {'instances', 'ram', 'cores'} {{(pid=120783) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:21:49.236851 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.quota [None req-f286c9b5-9c94-429d-9649-3bbf35eee0cf tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Getting quotas for user 3800f9c3071b4c908b4d378c69953228 and project 74107e05cf1644fc805625368fca2cbb. Resources: {'instances', 'ram', 'cores'} {{(pid=120783) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:21:49.243547 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-f1a72bde-dd25-4005-be36-0f7f5aec7291 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:49.247860 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-f1a72bde-dd25-4005-be36-0f7f5aec7291 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] [instance: 2c255852-5b9e-4539-a1a1-502d5b6b30cb] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:49.252219 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-f286c9b5-9c94-429d-9649-3bbf35eee0cf tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Going to run 1 instances... {{(pid=120783) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:21:49.255576 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-f286c9b5-9c94-429d-9649-3bbf35eee0cf tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] [instance: 286c8683-8bd6-4dcc-8540-cc73dd752da5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7d45cdd6-750f-40c7-9475-f7bf12fcb204',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120783) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:21:49.260545 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f1a72bde-dd25-4005-be36-0f7f5aec7291 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:49.261440 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f1a72bde-dd25-4005-be36-0f7f5aec7291 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:49.262197 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f1a72bde-dd25-4005-be36-0f7f5aec7291 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:49.263517 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f1a72bde-dd25-4005-be36-0f7f5aec7291 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:49.264317 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f1a72bde-dd25-4005-be36-0f7f5aec7291 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:49.265031 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f1a72bde-dd25-4005-be36-0f7f5aec7291 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:49.294959 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.wsgi [None req-f1a72bde-dd25-4005-be36-0f7f5aec7291 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] HTTP exception thrown: Instance 2c255852-5b9e-4539-a1a1-502d5b6b30cb could not be found. Aug 27 02:21:49.329854 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-f1a72bde-dd25-4005-be36-0f7f5aec7291 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Request method failure captured: Aug 27 02:21:49.329854 dv-cinder-846303-3-smb devstack@n-api.service[120782]: request: GET /compute/v2.1/servers/2c255852-5b9e-4539-a1a1-502d5b6b30cb/os-volume_attachments HTTP/1.1 Aug 27 02:21:49.329854 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Accept: application/json Aug 27 02:21:49.329854 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Accept-Encoding: identity Aug 27 02:21:49.329854 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Connection: close Aug 27 02:21:49.329854 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Content-Length: 0 Aug 27 02:21:49.329854 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Content-Type: application/json Aug 27 02:21:49.329854 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Host: 10.222.0.61 Aug 27 02:21:49.329854 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Openstack-System-Scope: None Aug 27 02:21:49.329854 dv-cinder-846303-3-smb devstack@n-api.service[120782]: User-Agent: python-urllib3/1.26.11 Aug 27 02:21:49.329854 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Auth-Token: gAAAAABjCX-Irp2pww3S-zCGxs79mH2yytVVwSDkVco1hCiNyqNYVTsaCfe5ar9lnku62Iksgcy8jxBVZm0TOfNKTbJjvFa7uiHF-lPlh_plkoKuN3Ef4_A4ODpDLxpr5DSVVI3xPlDW7szicrQVC0Wa1_lxmRy2HAUDwhn2f86kj_Lx_jYZcQo Aug 27 02:21:49.329854 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Domain-Id: None Aug 27 02:21:49.329854 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Domain-Name: None Aug 27 02:21:49.329854 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Identity-Status: Confirmed Aug 27 02:21:49.329854 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Is-Admin-Project: True Aug 27 02:21:49.329854 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Domain-Id: default Aug 27 02:21:49.329854 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Domain-Name: Default Aug 27 02:21:49.329854 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Id: b29ac730884f411b91b8cb922f7b0bea Aug 27 02:21:49.329854 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Name: tempest-DeleteServersTestJSON-814860316 Aug 27 02:21:49.329854 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Role: member,reader Aug 27 02:21:49.329854 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Roles: member,reader Aug 27 02:21:49.331319 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/b29ac730884f411b91b8cb922f7b0bea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_b29ac730884f411b91b8cb922f7b0bea", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b29ac730884f411b91b8cb922f7b0bea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b29ac730884f411b91b8cb922f7b0bea"}]}] Aug 27 02:21:49.331319 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Tenant: tempest-DeleteServersTestJSON-814860316 Aug 27 02:21:49.331319 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Tenant-Id: b29ac730884f411b91b8cb922f7b0bea Aug 27 02:21:49.331319 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Tenant-Name: tempest-DeleteServersTestJSON-814860316 Aug 27 02:21:49.331319 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User: tempest-DeleteServersTestJSON-814860316-project Aug 27 02:21:49.331319 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Domain-Id: default Aug 27 02:21:49.331319 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Domain-Name: Default Aug 27 02:21:49.331319 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Id: 8fcf84d1b6d04255b62ab22d35e80280 Aug 27 02:21:49.331319 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Name: tempest-DeleteServersTestJSON-814860316-project Aug 27 02:21:49.331319 dv-cinder-846303-3-smb devstack@n-api.service[120782]: method: > Aug 27 02:21:49.331319 dv-cinder-846303-3-smb devstack@n-api.service[120782]: exception: Instance 2c255852-5b9e-4539-a1a1-502d5b6b30cb could not be found. Aug 27 02:21:49.331319 dv-cinder-846303-3-smb devstack@n-api.service[120782]: action_args: {'server_id': '2c255852-5b9e-4539-a1a1-502d5b6b30cb'} Aug 27 02:21:49.332059 dv-cinder-846303-3-smb devstack@n-api.service[120782]: {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:21:49.332059 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:21:49.332059 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:21:49.332059 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:21:49.332059 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:21:49.332059 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:21:49.332059 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:21:49.332059 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:21:49.332059 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:21:49.332059 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:21:49.332059 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c255852-5b9e-4539-a1a1-502d5b6b30cb could not be found. Aug 27 02:21:49.332059 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:21:49.332059 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:21:49.332059 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:21:49.332059 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:21:49.332059 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:21:49.332059 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:21:49.332059 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:21:49.332059 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:21:49.332059 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:21:49.333253 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:21:49.333253 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 02:21:49.333253 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:21:49.333253 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 02:21:49.333253 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:21:49.333253 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 27 02:21:49.333253 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 27 02:21:49.333253 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:21:49.333253 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:21:49.333253 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c255852-5b9e-4539-a1a1-502d5b6b30cb could not be found. Aug 27 02:21:49.333253 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:21:49.333253 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:21:49.333253 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:21:49.333253 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:21:49.333253 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:21:49.333253 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:21:49.333253 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:21:49.333253 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:21:49.333253 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c255852-5b9e-4539-a1a1-502d5b6b30cb could not be found. Aug 27 02:21:49.333253 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:21:49.336386 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-f286c9b5-9c94-429d-9649-3bbf35eee0cf tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.645872 Aug 27 02:21:49.338208 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-f1a72bde-dd25-4005-be36-0f7f5aec7291 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Returning 404 to user: Instance 2c255852-5b9e-4539-a1a1-502d5b6b30cb could not be found. {{(pid=120782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:21:49.341167 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-f1a72bde-dd25-4005-be36-0f7f5aec7291 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] 10.222.0.61 "GET /compute/v2.1/servers/2c255852-5b9e-4539-a1a1-502d5b6b30cb/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.104822 Aug 27 02:21:49.341810 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 73/151] 10.222.0.61 () {60 vars in 1147 bytes} [Sat Aug 27 02:21:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 652 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 02:21:49.343278 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 79/152] 10.222.0.61 () {58 vars in 1302 bytes} [Sat Aug 27 02:21:49 2022] GET /compute/v2.1/servers/2c255852-5b9e-4539-a1a1-502d5b6b30cb/os-volume_attachments => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:21:49.354610 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-80c8a05f-1be7-4739-8bb5-e99c12761c31 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:49.357328 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-80c8a05f-1be7-4739-8bb5-e99c12761c31 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] [instance: 286c8683-8bd6-4dcc-8540-cc73dd752da5] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:49.509471 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-80c8a05f-1be7-4739-8bb5-e99c12761c31 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3800f9c3071b4c908b4d378c69953228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74107e05cf1644fc805625368fca2cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:49.527290 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-80c8a05f-1be7-4739-8bb5-e99c12761c31 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] 10.222.0.61 "GET /compute/v2.1/servers/286c8683-8bd6-4dcc-8540-cc73dd752da5" status: 200 len: 1215 microversion: 2.1 time: 0.175989 Aug 27 02:21:49.529084 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 74/153] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:49 2022] GET /compute/v2.1/servers/286c8683-8bd6-4dcc-8540-cc73dd752da5 => generated 1215 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:21:49.530559 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [req-895f7e25-71db-47c6-a1a9-071276cfede2 req-25620dfb-fbf9-4843-ac34-1717e3452f3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fedf0d1-cc1c-4947-b92e-dcb4454889d1", "tag": "4bd07b6a-31ef-4e06-8c83-8a4ce8a68542"}]} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:21:49.584282 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-895f7e25-71db-47c6-a1a9-071276cfede2 req-25620dfb-fbf9-4843-ac34-1717e3452f3b service nova] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:49.586113 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-895f7e25-71db-47c6-a1a9-071276cfede2 req-25620dfb-fbf9-4843-ac34-1717e3452f3b service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:49.587947 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-895f7e25-71db-47c6-a1a9-071276cfede2 req-25620dfb-fbf9-4843-ac34-1717e3452f3b service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:49.644140 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-a1d8631b-f9f3-450a-8e3b-d9a82093e8fd tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:49.646952 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.compute.server_external_events [req-895f7e25-71db-47c6-a1a9-071276cfede2 req-25620dfb-fbf9-4843-ac34-1717e3452f3b service nova] Creating event network-changed:4bd07b6a-31ef-4e06-8c83-8a4ce8a68542 for instance 4fedf0d1-cc1c-4947-b92e-dcb4454889d1 on hv-cinder-84630 Aug 27 02:21:49.653539 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-a1d8631b-f9f3-450a-8e3b-d9a82093e8fd tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] [instance: 6dffef84-3605-422f-ac42-8c1614b24539] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:49.664941 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [req-895f7e25-71db-47c6-a1a9-071276cfede2 req-25620dfb-fbf9-4843-ac34-1717e3452f3b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138637 Aug 27 02:21:49.666669 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 80/154] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Aug 27 02:21:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:21:49.692093 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a1d8631b-f9f3-450a-8e3b-d9a82093e8fd tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:49.705085 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a1d8631b-f9f3-450a-8e3b-d9a82093e8fd tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:49.705085 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a1d8631b-f9f3-450a-8e3b-d9a82093e8fd tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:49.710547 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a1d8631b-f9f3-450a-8e3b-d9a82093e8fd tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:49.711065 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a1d8631b-f9f3-450a-8e3b-d9a82093e8fd tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:49.711584 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a1d8631b-f9f3-450a-8e3b-d9a82093e8fd tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:49.848595 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-a1d8631b-f9f3-450a-8e3b-d9a82093e8fd tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc3be23405d4ae88dd46d656ad6a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc715590f88432d9b6e7dd779ad5851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:49.868475 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-a1d8631b-f9f3-450a-8e3b-d9a82093e8fd tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] 10.222.0.61 "GET /compute/v2.1/servers/6dffef84-3605-422f-ac42-8c1614b24539" status: 200 len: 1272 microversion: 2.1 time: 0.260159 Aug 27 02:21:49.871410 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 75/155] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:49 2022] GET /compute/v2.1/servers/6dffef84-3605-422f-ac42-8c1614b24539 => generated 1272 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:21:50.028071 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-89919e7f-349b-4d0c-80cc-7f38ab251771 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:50.033385 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-89919e7f-349b-4d0c-80cc-7f38ab251771 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 5cbe7ad9-5124-4014-9d2a-e877493b2a9e] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:50.061588 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-89919e7f-349b-4d0c-80cc-7f38ab251771 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:50.063190 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-89919e7f-349b-4d0c-80cc-7f38ab251771 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:50.064359 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-89919e7f-349b-4d0c-80cc-7f38ab251771 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:50.067520 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-89919e7f-349b-4d0c-80cc-7f38ab251771 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:50.068721 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-89919e7f-349b-4d0c-80cc-7f38ab251771 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:50.070854 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-89919e7f-349b-4d0c-80cc-7f38ab251771 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:50.477841 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-89919e7f-349b-4d0c-80cc-7f38ab251771 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:50.487460 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-89919e7f-349b-4d0c-80cc-7f38ab251771 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e" status: 200 len: 1522 microversion: 2.1 time: 0.468036 Aug 27 02:21:50.501654 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 81/156] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:50 2022] GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e => generated 1522 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:21:50.578772 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-98c46d45-2a46-4a78-9d48-6c1eb66e2445 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:50.581857 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-98c46d45-2a46-4a78-9d48-6c1eb66e2445 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] [instance: 286c8683-8bd6-4dcc-8540-cc73dd752da5] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:50.594571 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-98c46d45-2a46-4a78-9d48-6c1eb66e2445 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:50.595618 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-98c46d45-2a46-4a78-9d48-6c1eb66e2445 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:50.596472 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-98c46d45-2a46-4a78-9d48-6c1eb66e2445 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:50.599445 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-98c46d45-2a46-4a78-9d48-6c1eb66e2445 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:50.601227 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-98c46d45-2a46-4a78-9d48-6c1eb66e2445 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:50.602326 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-98c46d45-2a46-4a78-9d48-6c1eb66e2445 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:50.744926 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-41548666-cf4d-45b8-8ab7-36cb43b13e97 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:50.745766 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-41548666-cf4d-45b8-8ab7-36cb43b13e97 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] [instance: 2c255852-5b9e-4539-a1a1-502d5b6b30cb] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:50.756446 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-41548666-cf4d-45b8-8ab7-36cb43b13e97 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:50.757674 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-41548666-cf4d-45b8-8ab7-36cb43b13e97 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:50.759956 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-41548666-cf4d-45b8-8ab7-36cb43b13e97 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:50.761826 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-41548666-cf4d-45b8-8ab7-36cb43b13e97 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:50.762833 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-41548666-cf4d-45b8-8ab7-36cb43b13e97 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:50.763829 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-41548666-cf4d-45b8-8ab7-36cb43b13e97 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:50.773017 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-98c46d45-2a46-4a78-9d48-6c1eb66e2445 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3800f9c3071b4c908b4d378c69953228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74107e05cf1644fc805625368fca2cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:50.786380 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-98c46d45-2a46-4a78-9d48-6c1eb66e2445 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] 10.222.0.61 "GET /compute/v2.1/servers/286c8683-8bd6-4dcc-8540-cc73dd752da5" status: 200 len: 1211 microversion: 2.1 time: 0.223377 Aug 27 02:21:50.804207 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 76/157] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:50 2022] GET /compute/v2.1/servers/286c8683-8bd6-4dcc-8540-cc73dd752da5 => generated 1211 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:21:50.815799 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.wsgi [None req-41548666-cf4d-45b8-8ab7-36cb43b13e97 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] HTTP exception thrown: Instance 2c255852-5b9e-4539-a1a1-502d5b6b30cb could not be found. Aug 27 02:21:50.817578 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-41548666-cf4d-45b8-8ab7-36cb43b13e97 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Request method failure captured: Aug 27 02:21:50.817578 dv-cinder-846303-3-smb devstack@n-api.service[120782]: request: DELETE /compute/v2.1/servers/2c255852-5b9e-4539-a1a1-502d5b6b30cb HTTP/1.1 Aug 27 02:21:50.817578 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Accept: application/json Aug 27 02:21:50.817578 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Accept-Encoding: identity Aug 27 02:21:50.817578 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Connection: close Aug 27 02:21:50.817578 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Content-Length: 0 Aug 27 02:21:50.817578 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Content-Type: application/json Aug 27 02:21:50.817578 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Host: 10.222.0.61 Aug 27 02:21:50.817578 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Openstack-System-Scope: None Aug 27 02:21:50.817578 dv-cinder-846303-3-smb devstack@n-api.service[120782]: User-Agent: python-urllib3/1.26.11 Aug 27 02:21:50.817578 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Auth-Token: gAAAAABjCX-Irp2pww3S-zCGxs79mH2yytVVwSDkVco1hCiNyqNYVTsaCfe5ar9lnku62Iksgcy8jxBVZm0TOfNKTbJjvFa7uiHF-lPlh_plkoKuN3Ef4_A4ODpDLxpr5DSVVI3xPlDW7szicrQVC0Wa1_lxmRy2HAUDwhn2f86kj_Lx_jYZcQo Aug 27 02:21:50.817578 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Domain-Id: None Aug 27 02:21:50.817578 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Domain-Name: None Aug 27 02:21:50.817578 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Identity-Status: Confirmed Aug 27 02:21:50.817578 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Is-Admin-Project: True Aug 27 02:21:50.817578 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Domain-Id: default Aug 27 02:21:50.817578 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Domain-Name: Default Aug 27 02:21:50.817578 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Id: b29ac730884f411b91b8cb922f7b0bea Aug 27 02:21:50.817578 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Name: tempest-DeleteServersTestJSON-814860316 Aug 27 02:21:50.817578 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Role: member,reader Aug 27 02:21:50.817578 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Roles: member,reader Aug 27 02:21:50.818996 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/b29ac730884f411b91b8cb922f7b0bea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_b29ac730884f411b91b8cb922f7b0bea", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b29ac730884f411b91b8cb922f7b0bea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b29ac730884f411b91b8cb922f7b0bea"}]}] Aug 27 02:21:50.818996 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Tenant: tempest-DeleteServersTestJSON-814860316 Aug 27 02:21:50.818996 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Tenant-Id: b29ac730884f411b91b8cb922f7b0bea Aug 27 02:21:50.818996 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Tenant-Name: tempest-DeleteServersTestJSON-814860316 Aug 27 02:21:50.818996 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User: tempest-DeleteServersTestJSON-814860316-project Aug 27 02:21:50.818996 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Domain-Id: default Aug 27 02:21:50.818996 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Domain-Name: Default Aug 27 02:21:50.818996 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Id: 8fcf84d1b6d04255b62ab22d35e80280 Aug 27 02:21:50.818996 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Name: tempest-DeleteServersTestJSON-814860316-project Aug 27 02:21:50.818996 dv-cinder-846303-3-smb devstack@n-api.service[120782]: method: > Aug 27 02:21:50.818996 dv-cinder-846303-3-smb devstack@n-api.service[120782]: exception: Instance 2c255852-5b9e-4539-a1a1-502d5b6b30cb could not be found. Aug 27 02:21:50.818996 dv-cinder-846303-3-smb devstack@n-api.service[120782]: action_args: {'id': '2c255852-5b9e-4539-a1a1-502d5b6b30cb'} Aug 27 02:21:50.819698 dv-cinder-846303-3-smb devstack@n-api.service[120782]: {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:21:50.819698 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:21:50.819698 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:21:50.819698 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:21:50.819698 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:21:50.819698 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:21:50.819698 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:21:50.819698 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:21:50.819698 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:21:50.819698 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:21:50.819698 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c255852-5b9e-4539-a1a1-502d5b6b30cb could not be found. Aug 27 02:21:50.819698 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:21:50.819698 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:21:50.819698 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:21:50.819698 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:21:50.819698 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:21:50.819698 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:21:50.819698 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:21:50.819698 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:21:50.819698 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:21:50.820701 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:21:50.820701 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 02:21:50.820701 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 02:21:50.820701 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 02:21:50.820701 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 02:21:50.820701 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:21:50.820701 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:21:50.820701 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:21:50.820701 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:21:50.820701 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c255852-5b9e-4539-a1a1-502d5b6b30cb could not be found. Aug 27 02:21:50.820701 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:21:50.820701 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:21:50.820701 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:21:50.820701 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:21:50.820701 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:21:50.820701 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:21:50.820701 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:21:50.820701 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:21:50.820701 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c255852-5b9e-4539-a1a1-502d5b6b30cb could not be found. Aug 27 02:21:50.820701 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:21:50.823729 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-41548666-cf4d-45b8-8ab7-36cb43b13e97 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Returning 404 to user: Instance 2c255852-5b9e-4539-a1a1-502d5b6b30cb could not be found. {{(pid=120782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:21:50.824911 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-41548666-cf4d-45b8-8ab7-36cb43b13e97 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] 10.222.0.61 "DELETE /compute/v2.1/servers/2c255852-5b9e-4539-a1a1-502d5b6b30cb" status: 404 len: 111 microversion: 2.1 time: 0.087843 Aug 27 02:21:50.826091 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 82/158] 10.222.0.61 () {58 vars in 1239 bytes} [Sat Aug 27 02:21:50 2022] DELETE /compute/v2.1/servers/2c255852-5b9e-4539-a1a1-502d5b6b30cb => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:21:50.840304 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-2687148d-9d2b-410b-9737-32deeb737bc0 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:50.841460 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-2687148d-9d2b-410b-9737-32deeb737bc0 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] [instance: 2c255852-5b9e-4539-a1a1-502d5b6b30cb] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:50.853225 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2687148d-9d2b-410b-9737-32deeb737bc0 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:50.854205 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2687148d-9d2b-410b-9737-32deeb737bc0 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:50.854996 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2687148d-9d2b-410b-9737-32deeb737bc0 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:50.856465 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2687148d-9d2b-410b-9737-32deeb737bc0 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:50.857280 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2687148d-9d2b-410b-9737-32deeb737bc0 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:50.858154 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2687148d-9d2b-410b-9737-32deeb737bc0 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:50.884821 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.wsgi [None req-2687148d-9d2b-410b-9737-32deeb737bc0 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] HTTP exception thrown: Instance 2c255852-5b9e-4539-a1a1-502d5b6b30cb could not be found. Aug 27 02:21:50.895559 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-2687148d-9d2b-410b-9737-32deeb737bc0 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Request method failure captured: Aug 27 02:21:50.895559 dv-cinder-846303-3-smb devstack@n-api.service[120783]: request: GET /compute/v2.1/servers/2c255852-5b9e-4539-a1a1-502d5b6b30cb HTTP/1.1 Aug 27 02:21:50.895559 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Accept: application/json Aug 27 02:21:50.895559 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Accept-Encoding: identity Aug 27 02:21:50.895559 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Connection: close Aug 27 02:21:50.895559 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Content-Length: 0 Aug 27 02:21:50.895559 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Content-Type: application/json Aug 27 02:21:50.895559 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Host: 10.222.0.61 Aug 27 02:21:50.895559 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Openstack-System-Scope: None Aug 27 02:21:50.895559 dv-cinder-846303-3-smb devstack@n-api.service[120783]: User-Agent: python-urllib3/1.26.11 Aug 27 02:21:50.895559 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Auth-Token: gAAAAABjCX-Irp2pww3S-zCGxs79mH2yytVVwSDkVco1hCiNyqNYVTsaCfe5ar9lnku62Iksgcy8jxBVZm0TOfNKTbJjvFa7uiHF-lPlh_plkoKuN3Ef4_A4ODpDLxpr5DSVVI3xPlDW7szicrQVC0Wa1_lxmRy2HAUDwhn2f86kj_Lx_jYZcQo Aug 27 02:21:50.895559 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Domain-Id: None Aug 27 02:21:50.895559 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Domain-Name: None Aug 27 02:21:50.895559 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Identity-Status: Confirmed Aug 27 02:21:50.895559 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Is-Admin-Project: True Aug 27 02:21:50.895559 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Project-Domain-Id: default Aug 27 02:21:50.895559 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Project-Domain-Name: Default Aug 27 02:21:50.895559 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Project-Id: b29ac730884f411b91b8cb922f7b0bea Aug 27 02:21:50.895559 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Project-Name: tempest-DeleteServersTestJSON-814860316 Aug 27 02:21:50.895559 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Role: member,reader Aug 27 02:21:50.895559 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Roles: member,reader Aug 27 02:21:50.897235 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/b29ac730884f411b91b8cb922f7b0bea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_b29ac730884f411b91b8cb922f7b0bea", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b29ac730884f411b91b8cb922f7b0bea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b29ac730884f411b91b8cb922f7b0bea"}]}] Aug 27 02:21:50.897235 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Tenant: tempest-DeleteServersTestJSON-814860316 Aug 27 02:21:50.897235 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Tenant-Id: b29ac730884f411b91b8cb922f7b0bea Aug 27 02:21:50.897235 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Tenant-Name: tempest-DeleteServersTestJSON-814860316 Aug 27 02:21:50.897235 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User: tempest-DeleteServersTestJSON-814860316-project Aug 27 02:21:50.897235 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User-Domain-Id: default Aug 27 02:21:50.897235 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User-Domain-Name: Default Aug 27 02:21:50.897235 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User-Id: 8fcf84d1b6d04255b62ab22d35e80280 Aug 27 02:21:50.897235 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User-Name: tempest-DeleteServersTestJSON-814860316-project Aug 27 02:21:50.897235 dv-cinder-846303-3-smb devstack@n-api.service[120783]: method: > Aug 27 02:21:50.897235 dv-cinder-846303-3-smb devstack@n-api.service[120783]: exception: Instance 2c255852-5b9e-4539-a1a1-502d5b6b30cb could not be found. Aug 27 02:21:50.897235 dv-cinder-846303-3-smb devstack@n-api.service[120783]: action_args: {'id': '2c255852-5b9e-4539-a1a1-502d5b6b30cb'} Aug 27 02:21:50.898063 dv-cinder-846303-3-smb devstack@n-api.service[120783]: {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:21:50.898063 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:21:50.898063 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:21:50.898063 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:21:50.898063 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:21:50.898063 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:21:50.898063 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:21:50.898063 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:21:50.898063 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:21:50.898063 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:21:50.898063 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c255852-5b9e-4539-a1a1-502d5b6b30cb could not be found. Aug 27 02:21:50.898063 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:21:50.898063 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:21:50.898063 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:21:50.898063 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:21:50.898063 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:21:50.898063 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:21:50.898063 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:21:50.898063 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:21:50.898063 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:21:50.899245 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:21:50.899245 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:21:50.899245 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:21:50.899245 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:21:50.899245 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:21:50.899245 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:21:50.899245 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:21:50.899245 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c255852-5b9e-4539-a1a1-502d5b6b30cb could not be found. Aug 27 02:21:50.899245 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:21:50.899245 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:21:50.899245 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:21:50.899245 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:21:50.899245 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:21:50.899245 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:21:50.899245 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:21:50.899245 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:21:50.899245 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c255852-5b9e-4539-a1a1-502d5b6b30cb could not be found. Aug 27 02:21:50.899245 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:21:50.900540 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-2687148d-9d2b-410b-9737-32deeb737bc0 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] Returning 404 to user: Instance 2c255852-5b9e-4539-a1a1-502d5b6b30cb could not be found. {{(pid=120783) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:21:50.901170 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-2687148d-9d2b-410b-9737-32deeb737bc0 tempest-DeleteServersTestJSON-814860316 tempest-DeleteServersTestJSON-814860316-project] 10.222.0.61 "GET /compute/v2.1/servers/2c255852-5b9e-4539-a1a1-502d5b6b30cb" status: 404 len: 111 microversion: 2.1 time: 0.065964 Aug 27 02:21:50.910096 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 77/159] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:50 2022] GET /compute/v2.1/servers/2c255852-5b9e-4539-a1a1-502d5b6b30cb => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:21:50.910354 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-73fbd2d2-3ccb-4f4a-b4f9-f1cd17bdf041 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:50.915291 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-73fbd2d2-3ccb-4f4a-b4f9-f1cd17bdf041 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] [instance: 6dffef84-3605-422f-ac42-8c1614b24539] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:50.931524 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-73fbd2d2-3ccb-4f4a-b4f9-f1cd17bdf041 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:50.932290 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-73fbd2d2-3ccb-4f4a-b4f9-f1cd17bdf041 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:50.932930 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-73fbd2d2-3ccb-4f4a-b4f9-f1cd17bdf041 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:50.934399 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-73fbd2d2-3ccb-4f4a-b4f9-f1cd17bdf041 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:50.936606 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-73fbd2d2-3ccb-4f4a-b4f9-f1cd17bdf041 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:50.937815 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-73fbd2d2-3ccb-4f4a-b4f9-f1cd17bdf041 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:51.184471 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-73fbd2d2-3ccb-4f4a-b4f9-f1cd17bdf041 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc3be23405d4ae88dd46d656ad6a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc715590f88432d9b6e7dd779ad5851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:51.204234 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-73fbd2d2-3ccb-4f4a-b4f9-f1cd17bdf041 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] 10.222.0.61 "GET /compute/v2.1/servers/6dffef84-3605-422f-ac42-8c1614b24539" status: 200 len: 1270 microversion: 2.1 time: 0.301932 Aug 27 02:21:51.210979 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 83/160] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:50 2022] GET /compute/v2.1/servers/6dffef84-3605-422f-ac42-8c1614b24539 => generated 1270 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:21:51.513945 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-b418ce04-420f-4310-a86e-7068b943de27 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:51.519795 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-b418ce04-420f-4310-a86e-7068b943de27 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 5cbe7ad9-5124-4014-9d2a-e877493b2a9e] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:51.543206 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b418ce04-420f-4310-a86e-7068b943de27 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:51.544065 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b418ce04-420f-4310-a86e-7068b943de27 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:51.544857 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b418ce04-420f-4310-a86e-7068b943de27 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:51.546111 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b418ce04-420f-4310-a86e-7068b943de27 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:51.546897 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b418ce04-420f-4310-a86e-7068b943de27 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:51.547641 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b418ce04-420f-4310-a86e-7068b943de27 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:51.828375 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-b16fbdbc-0b5f-4dda-88b2-773fc765f496 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:51.831597 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-b16fbdbc-0b5f-4dda-88b2-773fc765f496 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] [instance: 286c8683-8bd6-4dcc-8540-cc73dd752da5] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:51.845245 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b16fbdbc-0b5f-4dda-88b2-773fc765f496 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:51.845784 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b16fbdbc-0b5f-4dda-88b2-773fc765f496 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:51.848659 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b16fbdbc-0b5f-4dda-88b2-773fc765f496 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:51.849536 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b16fbdbc-0b5f-4dda-88b2-773fc765f496 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:51.850015 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b16fbdbc-0b5f-4dda-88b2-773fc765f496 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:51.852148 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b16fbdbc-0b5f-4dda-88b2-773fc765f496 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:51.912731 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-b418ce04-420f-4310-a86e-7068b943de27 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:51.926397 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-b418ce04-420f-4310-a86e-7068b943de27 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e" status: 200 len: 1522 microversion: 2.1 time: 0.420301 Aug 27 02:21:51.929709 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 78/161] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:51 2022] GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e => generated 1522 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:21:52.049344 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-b16fbdbc-0b5f-4dda-88b2-773fc765f496 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3800f9c3071b4c908b4d378c69953228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74107e05cf1644fc805625368fca2cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:52.072169 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-b16fbdbc-0b5f-4dda-88b2-773fc765f496 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] 10.222.0.61 "GET /compute/v2.1/servers/286c8683-8bd6-4dcc-8540-cc73dd752da5" status: 200 len: 1267 microversion: 2.1 time: 0.251697 Aug 27 02:21:52.073160 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 84/162] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:51 2022] GET /compute/v2.1/servers/286c8683-8bd6-4dcc-8540-cc73dd752da5 => generated 1267 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:21:52.237268 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-1bb1da3e-5656-4180-b1d2-694f0d563606 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:52.238116 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-1bb1da3e-5656-4180-b1d2-694f0d563606 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] [instance: 6dffef84-3605-422f-ac42-8c1614b24539] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:52.250797 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1bb1da3e-5656-4180-b1d2-694f0d563606 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:52.251319 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1bb1da3e-5656-4180-b1d2-694f0d563606 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:52.251713 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1bb1da3e-5656-4180-b1d2-694f0d563606 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:52.252413 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1bb1da3e-5656-4180-b1d2-694f0d563606 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:52.252861 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1bb1da3e-5656-4180-b1d2-694f0d563606 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:52.253681 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1bb1da3e-5656-4180-b1d2-694f0d563606 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:52.910520 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-1bb1da3e-5656-4180-b1d2-694f0d563606 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc3be23405d4ae88dd46d656ad6a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc715590f88432d9b6e7dd779ad5851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:52.934078 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-1bb1da3e-5656-4180-b1d2-694f0d563606 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] 10.222.0.61 "GET /compute/v2.1/servers/6dffef84-3605-422f-ac42-8c1614b24539" status: 200 len: 1312 microversion: 2.1 time: 0.700745 Aug 27 02:21:52.938460 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 79/163] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:52 2022] GET /compute/v2.1/servers/6dffef84-3605-422f-ac42-8c1614b24539 => generated 1312 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:21:52.969324 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-36b83816-6168-4cec-8a66-3d031fee218a tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:52.971315 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-36b83816-6168-4cec-8a66-3d031fee218a tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 5cbe7ad9-5124-4014-9d2a-e877493b2a9e] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:52.983081 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-36b83816-6168-4cec-8a66-3d031fee218a tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:52.983628 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-36b83816-6168-4cec-8a66-3d031fee218a tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:52.984060 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-36b83816-6168-4cec-8a66-3d031fee218a tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:52.984761 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-36b83816-6168-4cec-8a66-3d031fee218a tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:52.985207 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-36b83816-6168-4cec-8a66-3d031fee218a tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:52.985808 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-36b83816-6168-4cec-8a66-3d031fee218a tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:53.116522 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-93e9346b-4d39-459d-93a4-e86761c0ca2b tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:53.118656 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-93e9346b-4d39-459d-93a4-e86761c0ca2b tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] [instance: 286c8683-8bd6-4dcc-8540-cc73dd752da5] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:53.130985 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-93e9346b-4d39-459d-93a4-e86761c0ca2b tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:53.132294 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-93e9346b-4d39-459d-93a4-e86761c0ca2b tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:53.135671 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-93e9346b-4d39-459d-93a4-e86761c0ca2b tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:53.137867 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-93e9346b-4d39-459d-93a4-e86761c0ca2b tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:53.138904 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-93e9346b-4d39-459d-93a4-e86761c0ca2b tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:53.143572 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-93e9346b-4d39-459d-93a4-e86761c0ca2b tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:53.183511 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:53.290320 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-93e9346b-4d39-459d-93a4-e86761c0ca2b tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3800f9c3071b4c908b4d378c69953228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74107e05cf1644fc805625368fca2cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:53.304199 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-93e9346b-4d39-459d-93a4-e86761c0ca2b tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] 10.222.0.61 "GET /compute/v2.1/servers/286c8683-8bd6-4dcc-8540-cc73dd752da5" status: 200 len: 1273 microversion: 2.1 time: 0.201049 Aug 27 02:21:53.318261 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 80/164] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:53 2022] GET /compute/v2.1/servers/286c8683-8bd6-4dcc-8540-cc73dd752da5 => generated 1273 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:21:53.399573 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-36b83816-6168-4cec-8a66-3d031fee218a tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:53.413880 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-36b83816-6168-4cec-8a66-3d031fee218a tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e" status: 200 len: 1522 microversion: 2.1 time: 0.452265 Aug 27 02:21:53.414828 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 85/165] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:52 2022] GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e => generated 1522 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:21:53.482917 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [req-69e3c37e-e972-4b24-b743-e8d0c1ee5b34 req-846ec83a-34cf-403b-a57b-11783db88c00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6dffef84-3605-422f-ac42-8c1614b24539", "tag": "8c960645-780e-4056-84f6-f734369fcc20"}]} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:21:53.522504 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-69e3c37e-e972-4b24-b743-e8d0c1ee5b34 req-846ec83a-34cf-403b-a57b-11783db88c00 service nova] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:53.523276 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-69e3c37e-e972-4b24-b743-e8d0c1ee5b34 req-846ec83a-34cf-403b-a57b-11783db88c00 service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:53.524164 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-69e3c37e-e972-4b24-b743-e8d0c1ee5b34 req-846ec83a-34cf-403b-a57b-11783db88c00 service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:53.539591 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.compute.server_external_events [req-69e3c37e-e972-4b24-b743-e8d0c1ee5b34 req-846ec83a-34cf-403b-a57b-11783db88c00 service nova] Creating event network-changed:8c960645-780e-4056-84f6-f734369fcc20 for instance 6dffef84-3605-422f-ac42-8c1614b24539 on hv-cinder-84630 Aug 27 02:21:53.548865 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [req-69e3c37e-e972-4b24-b743-e8d0c1ee5b34 req-846ec83a-34cf-403b-a57b-11783db88c00 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072267 Aug 27 02:21:53.552759 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 81/166] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Aug 27 02:21:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:21:53.971441 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-efd5a1bd-4e77-4029-b0b7-ca196bcfe1bc tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:53.973700 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-efd5a1bd-4e77-4029-b0b7-ca196bcfe1bc tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] [instance: 6dffef84-3605-422f-ac42-8c1614b24539] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:54.003125 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-efd5a1bd-4e77-4029-b0b7-ca196bcfe1bc tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:54.004290 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-efd5a1bd-4e77-4029-b0b7-ca196bcfe1bc tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:54.007867 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-efd5a1bd-4e77-4029-b0b7-ca196bcfe1bc tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:54.013147 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-efd5a1bd-4e77-4029-b0b7-ca196bcfe1bc tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:54.014471 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-efd5a1bd-4e77-4029-b0b7-ca196bcfe1bc tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:54.015754 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-efd5a1bd-4e77-4029-b0b7-ca196bcfe1bc tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:54.301352 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-efd5a1bd-4e77-4029-b0b7-ca196bcfe1bc tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc3be23405d4ae88dd46d656ad6a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc715590f88432d9b6e7dd779ad5851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:54.329185 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-8588b0b7-5aca-4ffa-a4ba-a654054e2ec4 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:54.329979 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-8588b0b7-5aca-4ffa-a4ba-a654054e2ec4 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] [instance: 286c8683-8bd6-4dcc-8540-cc73dd752da5] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:54.341232 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8588b0b7-5aca-4ffa-a4ba-a654054e2ec4 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:54.342061 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8588b0b7-5aca-4ffa-a4ba-a654054e2ec4 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:54.342968 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8588b0b7-5aca-4ffa-a4ba-a654054e2ec4 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:54.343768 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8588b0b7-5aca-4ffa-a4ba-a654054e2ec4 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:54.344235 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8588b0b7-5aca-4ffa-a4ba-a654054e2ec4 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:54.344661 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8588b0b7-5aca-4ffa-a4ba-a654054e2ec4 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:54.352065 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-efd5a1bd-4e77-4029-b0b7-ca196bcfe1bc tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] 10.222.0.61 "GET /compute/v2.1/servers/6dffef84-3605-422f-ac42-8c1614b24539" status: 200 len: 1312 microversion: 2.1 time: 0.395737 Aug 27 02:21:54.353491 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 86/167] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:53 2022] GET /compute/v2.1/servers/6dffef84-3605-422f-ac42-8c1614b24539 => generated 1312 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:21:54.454426 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-d1b8d0ef-277c-42f8-a105-82b76ddb724a tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:54.455652 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-d1b8d0ef-277c-42f8-a105-82b76ddb724a tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 5cbe7ad9-5124-4014-9d2a-e877493b2a9e] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:54.463965 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d1b8d0ef-277c-42f8-a105-82b76ddb724a tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:54.464630 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d1b8d0ef-277c-42f8-a105-82b76ddb724a tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:54.465465 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d1b8d0ef-277c-42f8-a105-82b76ddb724a tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:54.466660 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d1b8d0ef-277c-42f8-a105-82b76ddb724a tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:54.467230 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d1b8d0ef-277c-42f8-a105-82b76ddb724a tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:54.467850 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d1b8d0ef-277c-42f8-a105-82b76ddb724a tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:54.554580 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-8588b0b7-5aca-4ffa-a4ba-a654054e2ec4 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3800f9c3071b4c908b4d378c69953228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74107e05cf1644fc805625368fca2cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:54.582996 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-8588b0b7-5aca-4ffa-a4ba-a654054e2ec4 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] 10.222.0.61 "GET /compute/v2.1/servers/286c8683-8bd6-4dcc-8540-cc73dd752da5" status: 200 len: 1273 microversion: 2.1 time: 0.258594 Aug 27 02:21:54.598252 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 82/168] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:54 2022] GET /compute/v2.1/servers/286c8683-8bd6-4dcc-8540-cc73dd752da5 => generated 1273 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:21:54.681666 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-d1b8d0ef-277c-42f8-a105-82b76ddb724a tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:54.690881 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-d1b8d0ef-277c-42f8-a105-82b76ddb724a tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e" status: 200 len: 1522 microversion: 2.1 time: 0.243216 Aug 27 02:21:54.691529 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 87/169] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:54 2022] GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e => generated 1522 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:21:55.388917 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-52b5bedf-19ff-4e60-9b00-ba15c1ef3e0a tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:55.389655 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-52b5bedf-19ff-4e60-9b00-ba15c1ef3e0a tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] [instance: 6dffef84-3605-422f-ac42-8c1614b24539] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:55.397094 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-52b5bedf-19ff-4e60-9b00-ba15c1ef3e0a tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:55.397735 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-52b5bedf-19ff-4e60-9b00-ba15c1ef3e0a tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:55.398175 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-52b5bedf-19ff-4e60-9b00-ba15c1ef3e0a tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:55.398881 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-52b5bedf-19ff-4e60-9b00-ba15c1ef3e0a tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:55.399323 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-52b5bedf-19ff-4e60-9b00-ba15c1ef3e0a tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:55.399915 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-52b5bedf-19ff-4e60-9b00-ba15c1ef3e0a tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:55.608751 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-3538fc2a-ada1-4abc-b866-280d3d659436 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:55.610123 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-3538fc2a-ada1-4abc-b866-280d3d659436 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] [instance: 286c8683-8bd6-4dcc-8540-cc73dd752da5] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:55.623512 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3538fc2a-ada1-4abc-b866-280d3d659436 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:55.625244 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3538fc2a-ada1-4abc-b866-280d3d659436 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:55.625823 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3538fc2a-ada1-4abc-b866-280d3d659436 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:55.627189 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3538fc2a-ada1-4abc-b866-280d3d659436 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:55.630032 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3538fc2a-ada1-4abc-b866-280d3d659436 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:55.633745 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3538fc2a-ada1-4abc-b866-280d3d659436 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:55.843828 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-52b5bedf-19ff-4e60-9b00-ba15c1ef3e0a tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc3be23405d4ae88dd46d656ad6a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc715590f88432d9b6e7dd779ad5851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:55.868470 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-52b5bedf-19ff-4e60-9b00-ba15c1ef3e0a tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] 10.222.0.61 "GET /compute/v2.1/servers/6dffef84-3605-422f-ac42-8c1614b24539" status: 200 len: 1312 microversion: 2.1 time: 0.482801 Aug 27 02:21:55.870213 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 83/170] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:55 2022] GET /compute/v2.1/servers/6dffef84-3605-422f-ac42-8c1614b24539 => generated 1312 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:21:55.886733 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-2bd206b1-47a8-4df6-bf78-bd32c61c6a97 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:55.888208 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-2bd206b1-47a8-4df6-bf78-bd32c61c6a97 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 5cbe7ad9-5124-4014-9d2a-e877493b2a9e] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:55.896311 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2bd206b1-47a8-4df6-bf78-bd32c61c6a97 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:55.897099 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2bd206b1-47a8-4df6-bf78-bd32c61c6a97 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:55.897745 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2bd206b1-47a8-4df6-bf78-bd32c61c6a97 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:55.898784 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2bd206b1-47a8-4df6-bf78-bd32c61c6a97 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:55.899513 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2bd206b1-47a8-4df6-bf78-bd32c61c6a97 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:55.900094 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2bd206b1-47a8-4df6-bf78-bd32c61c6a97 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:56.011581 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-3538fc2a-ada1-4abc-b866-280d3d659436 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3800f9c3071b4c908b4d378c69953228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74107e05cf1644fc805625368fca2cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:56.020398 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-3538fc2a-ada1-4abc-b866-280d3d659436 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] 10.222.0.61 "GET /compute/v2.1/servers/286c8683-8bd6-4dcc-8540-cc73dd752da5" status: 200 len: 1315 microversion: 2.1 time: 0.417821 Aug 27 02:21:56.020963 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 88/171] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:55 2022] GET /compute/v2.1/servers/286c8683-8bd6-4dcc-8540-cc73dd752da5 => generated 1315 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:21:56.345931 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-2bd206b1-47a8-4df6-bf78-bd32c61c6a97 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:56.356555 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-2bd206b1-47a8-4df6-bf78-bd32c61c6a97 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e" status: 200 len: 1522 microversion: 2.1 time: 0.484309 Aug 27 02:21:56.357245 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 84/172] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:55 2022] GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e => generated 1522 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:21:56.900685 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-ed94b2a9-a479-469d-abaf-98f589710a7c tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:56.901603 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-ed94b2a9-a479-469d-abaf-98f589710a7c tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] [instance: 6dffef84-3605-422f-ac42-8c1614b24539] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:56.911863 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ed94b2a9-a479-469d-abaf-98f589710a7c tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:56.914008 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ed94b2a9-a479-469d-abaf-98f589710a7c tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:56.914914 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ed94b2a9-a479-469d-abaf-98f589710a7c tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:56.917516 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ed94b2a9-a479-469d-abaf-98f589710a7c tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:56.919762 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ed94b2a9-a479-469d-abaf-98f589710a7c tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:56.920526 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ed94b2a9-a479-469d-abaf-98f589710a7c tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:56.962654 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [req-e3fd1fa4-1751-4070-bcc3-34638bac00b2 req-5b1b7dc4-9e67-486b-979d-6893c2a3b011 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "286c8683-8bd6-4dcc-8540-cc73dd752da5", "tag": "c5ece479-76ab-48fe-baaa-f787a33a55f7"}]} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:21:56.979687 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-e3fd1fa4-1751-4070-bcc3-34638bac00b2 req-5b1b7dc4-9e67-486b-979d-6893c2a3b011 service nova] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:56.986131 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-e3fd1fa4-1751-4070-bcc3-34638bac00b2 req-5b1b7dc4-9e67-486b-979d-6893c2a3b011 service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:56.987910 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell0:SELECT=2 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:56.989189 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-e3fd1fa4-1751-4070-bcc3-34638bac00b2 req-5b1b7dc4-9e67-486b-979d-6893c2a3b011 service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:57.011176 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.compute.server_external_events [req-e3fd1fa4-1751-4070-bcc3-34638bac00b2 req-5b1b7dc4-9e67-486b-979d-6893c2a3b011 service nova] Creating event network-changed:c5ece479-76ab-48fe-baaa-f787a33a55f7 for instance 286c8683-8bd6-4dcc-8540-cc73dd752da5 on hv-cinder-84630 Aug 27 02:21:57.018058 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [req-e3fd1fa4-1751-4070-bcc3-34638bac00b2 req-5b1b7dc4-9e67-486b-979d-6893c2a3b011 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058958 Aug 27 02:21:57.018218 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell0:SELECT=6 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:57.020276 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 85/173] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Aug 27 02:21:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:21:57.042961 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-78c59fe5-78a3-4dbd-acfd-3acff6b16abf tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:57.043665 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-78c59fe5-78a3-4dbd-acfd-3acff6b16abf tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] [instance: 286c8683-8bd6-4dcc-8540-cc73dd752da5] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:57.051624 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-78c59fe5-78a3-4dbd-acfd-3acff6b16abf tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:57.052183 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-78c59fe5-78a3-4dbd-acfd-3acff6b16abf tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:57.053388 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-78c59fe5-78a3-4dbd-acfd-3acff6b16abf tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:57.054999 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-78c59fe5-78a3-4dbd-acfd-3acff6b16abf tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:57.055686 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-78c59fe5-78a3-4dbd-acfd-3acff6b16abf tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:57.056635 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-78c59fe5-78a3-4dbd-acfd-3acff6b16abf tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:57.295139 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-ed94b2a9-a479-469d-abaf-98f589710a7c tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc3be23405d4ae88dd46d656ad6a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc715590f88432d9b6e7dd779ad5851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:57.308643 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-ed94b2a9-a479-469d-abaf-98f589710a7c tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] 10.222.0.61 "GET /compute/v2.1/servers/6dffef84-3605-422f-ac42-8c1614b24539" status: 200 len: 1312 microversion: 2.1 time: 0.412179 Aug 27 02:21:57.330205 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 89/174] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:56 2022] GET /compute/v2.1/servers/6dffef84-3605-422f-ac42-8c1614b24539 => generated 1312 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:21:57.358136 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-78c59fe5-78a3-4dbd-acfd-3acff6b16abf tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3800f9c3071b4c908b4d378c69953228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74107e05cf1644fc805625368fca2cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:57.370632 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-78c59fe5-78a3-4dbd-acfd-3acff6b16abf tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] 10.222.0.61 "GET /compute/v2.1/servers/286c8683-8bd6-4dcc-8540-cc73dd752da5" status: 200 len: 1315 microversion: 2.1 time: 0.332186 Aug 27 02:21:57.371216 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 86/175] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:57 2022] GET /compute/v2.1/servers/286c8683-8bd6-4dcc-8540-cc73dd752da5 => generated 1315 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:21:57.394196 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-5f392149-4265-41f7-a69c-7b82f0945fde tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:57.395440 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-5f392149-4265-41f7-a69c-7b82f0945fde tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 5cbe7ad9-5124-4014-9d2a-e877493b2a9e] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:57.428552 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5f392149-4265-41f7-a69c-7b82f0945fde tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:57.429455 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5f392149-4265-41f7-a69c-7b82f0945fde tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:57.430221 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5f392149-4265-41f7-a69c-7b82f0945fde tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:57.432436 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5f392149-4265-41f7-a69c-7b82f0945fde tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:57.433296 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5f392149-4265-41f7-a69c-7b82f0945fde tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:57.434374 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5f392149-4265-41f7-a69c-7b82f0945fde tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:57.470068 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell1:SELECT=100 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:57.735281 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-5f392149-4265-41f7-a69c-7b82f0945fde tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:57.761896 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-5f392149-4265-41f7-a69c-7b82f0945fde tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e" status: 200 len: 1522 microversion: 2.1 time: 0.377535 Aug 27 02:21:57.763763 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 90/176] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:57 2022] GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e => generated 1522 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:21:58.331884 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-72b67750-0053-4c6d-8da6-4a39b247a3e4 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:58.332480 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-72b67750-0053-4c6d-8da6-4a39b247a3e4 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] [instance: 6dffef84-3605-422f-ac42-8c1614b24539] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:58.339590 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-72b67750-0053-4c6d-8da6-4a39b247a3e4 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:58.340076 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-72b67750-0053-4c6d-8da6-4a39b247a3e4 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:58.340504 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-72b67750-0053-4c6d-8da6-4a39b247a3e4 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:58.341431 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-72b67750-0053-4c6d-8da6-4a39b247a3e4 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:58.342036 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-72b67750-0053-4c6d-8da6-4a39b247a3e4 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:58.342454 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-72b67750-0053-4c6d-8da6-4a39b247a3e4 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:58.397050 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-4e749a3f-8c20-40a0-9745-22f9a98bc63f tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:58.398046 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-4e749a3f-8c20-40a0-9745-22f9a98bc63f tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] [instance: 286c8683-8bd6-4dcc-8540-cc73dd752da5] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:58.416956 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4e749a3f-8c20-40a0-9745-22f9a98bc63f tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:58.419999 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4e749a3f-8c20-40a0-9745-22f9a98bc63f tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:58.421006 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4e749a3f-8c20-40a0-9745-22f9a98bc63f tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:58.423125 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4e749a3f-8c20-40a0-9745-22f9a98bc63f tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:58.424089 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4e749a3f-8c20-40a0-9745-22f9a98bc63f tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:58.425027 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4e749a3f-8c20-40a0-9745-22f9a98bc63f tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:58.543843 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-72b67750-0053-4c6d-8da6-4a39b247a3e4 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc3be23405d4ae88dd46d656ad6a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc715590f88432d9b6e7dd779ad5851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:58.556998 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-72b67750-0053-4c6d-8da6-4a39b247a3e4 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] 10.222.0.61 "GET /compute/v2.1/servers/6dffef84-3605-422f-ac42-8c1614b24539" status: 200 len: 1312 microversion: 2.1 time: 0.228283 Aug 27 02:21:58.558863 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 87/177] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:58 2022] GET /compute/v2.1/servers/6dffef84-3605-422f-ac42-8c1614b24539 => generated 1312 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:21:58.659315 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-4e749a3f-8c20-40a0-9745-22f9a98bc63f tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3800f9c3071b4c908b4d378c69953228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74107e05cf1644fc805625368fca2cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:58.670765 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-4e749a3f-8c20-40a0-9745-22f9a98bc63f tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] 10.222.0.61 "GET /compute/v2.1/servers/286c8683-8bd6-4dcc-8540-cc73dd752da5" status: 200 len: 1315 microversion: 2.1 time: 0.281062 Aug 27 02:21:58.671606 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 91/178] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:58 2022] GET /compute/v2.1/servers/286c8683-8bd6-4dcc-8540-cc73dd752da5 => generated 1315 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:21:58.783545 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-0455b3f3-fa6a-423b-a10f-464a270c8fa3 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:58.784147 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-0455b3f3-fa6a-423b-a10f-464a270c8fa3 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 5cbe7ad9-5124-4014-9d2a-e877493b2a9e] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:58.790880 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0455b3f3-fa6a-423b-a10f-464a270c8fa3 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:58.791371 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0455b3f3-fa6a-423b-a10f-464a270c8fa3 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:58.791813 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0455b3f3-fa6a-423b-a10f-464a270c8fa3 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:58.792495 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0455b3f3-fa6a-423b-a10f-464a270c8fa3 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:58.792966 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0455b3f3-fa6a-423b-a10f-464a270c8fa3 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:58.793367 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0455b3f3-fa6a-423b-a10f-464a270c8fa3 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:58.964841 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-0455b3f3-fa6a-423b-a10f-464a270c8fa3 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:58.976316 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-0455b3f3-fa6a-423b-a10f-464a270c8fa3 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e" status: 200 len: 1522 microversion: 2.1 time: 0.196533 Aug 27 02:21:58.976906 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 88/179] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:58 2022] GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:21:59.579117 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-8a8d02d7-ab1f-4acd-a959-71748e7d8e7b tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:59.580476 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-8a8d02d7-ab1f-4acd-a959-71748e7d8e7b tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] [instance: 6dffef84-3605-422f-ac42-8c1614b24539] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:59.605346 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8a8d02d7-ab1f-4acd-a959-71748e7d8e7b tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:59.605923 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8a8d02d7-ab1f-4acd-a959-71748e7d8e7b tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:59.610811 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8a8d02d7-ab1f-4acd-a959-71748e7d8e7b tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:59.611580 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8a8d02d7-ab1f-4acd-a959-71748e7d8e7b tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:59.612052 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8a8d02d7-ab1f-4acd-a959-71748e7d8e7b tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:59.612481 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8a8d02d7-ab1f-4acd-a959-71748e7d8e7b tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:59.696589 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-882e451f-6686-4168-921a-15b0d6ce2b71 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:59.698204 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-882e451f-6686-4168-921a-15b0d6ce2b71 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] [instance: 286c8683-8bd6-4dcc-8540-cc73dd752da5] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:21:59.700671 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell0:SELECT=2 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:59.702342 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell0:SELECT=10 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:59.713122 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-882e451f-6686-4168-921a-15b0d6ce2b71 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:59.714160 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-882e451f-6686-4168-921a-15b0d6ce2b71 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:59.714730 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-882e451f-6686-4168-921a-15b0d6ce2b71 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:59.715655 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-882e451f-6686-4168-921a-15b0d6ce2b71 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:21:59.716915 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-882e451f-6686-4168-921a-15b0d6ce2b71 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:21:59.717864 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-882e451f-6686-4168-921a-15b0d6ce2b71 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:21:59.817877 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-8a8d02d7-ab1f-4acd-a959-71748e7d8e7b tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc3be23405d4ae88dd46d656ad6a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc715590f88432d9b6e7dd779ad5851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:21:59.824049 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-8a8d02d7-ab1f-4acd-a959-71748e7d8e7b tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] 10.222.0.61 "GET /compute/v2.1/servers/6dffef84-3605-422f-ac42-8c1614b24539" status: 200 len: 1312 microversion: 2.1 time: 0.249323 Aug 27 02:21:59.824651 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 92/180] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:59 2022] GET /compute/v2.1/servers/6dffef84-3605-422f-ac42-8c1614b24539 => generated 1312 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:21:59.997595 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-cd4aece7-eadd-4e1b-9929-e29ba390d6c3 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:21:59.998501 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-cd4aece7-eadd-4e1b-9929-e29ba390d6c3 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 5cbe7ad9-5124-4014-9d2a-e877493b2a9e] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:00.005277 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cd4aece7-eadd-4e1b-9929-e29ba390d6c3 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:00.005793 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cd4aece7-eadd-4e1b-9929-e29ba390d6c3 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:00.006221 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cd4aece7-eadd-4e1b-9929-e29ba390d6c3 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:00.006924 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cd4aece7-eadd-4e1b-9929-e29ba390d6c3 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:00.007364 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cd4aece7-eadd-4e1b-9929-e29ba390d6c3 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:00.007769 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cd4aece7-eadd-4e1b-9929-e29ba390d6c3 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:00.055409 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-882e451f-6686-4168-921a-15b0d6ce2b71 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3800f9c3071b4c908b4d378c69953228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74107e05cf1644fc805625368fca2cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:00.068527 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-882e451f-6686-4168-921a-15b0d6ce2b71 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] 10.222.0.61 "GET /compute/v2.1/servers/286c8683-8bd6-4dcc-8540-cc73dd752da5" status: 200 len: 1315 microversion: 2.1 time: 0.376736 Aug 27 02:22:00.070385 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 89/181] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:59 2022] GET /compute/v2.1/servers/286c8683-8bd6-4dcc-8540-cc73dd752da5 => generated 1315 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:22:00.226331 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-cd4aece7-eadd-4e1b-9929-e29ba390d6c3 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:00.238482 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-cd4aece7-eadd-4e1b-9929-e29ba390d6c3 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e" status: 200 len: 1522 microversion: 2.1 time: 0.244018 Aug 27 02:22:00.240185 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 93/182] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:21:59 2022] GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e => generated 1522 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:22:00.426642 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [req-75b77555-8eaf-459d-90ab-25f58dbb17a4 req-9d34289e-0f7a-4221-b0c5-3e3bdd85c9be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dffef84-3605-422f-ac42-8c1614b24539", "name": "network-vif-plugged", "status": "completed", "tag": "8c960645-780e-4056-84f6-f734369fcc20"}]} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:22:00.436508 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-75b77555-8eaf-459d-90ab-25f58dbb17a4 req-9d34289e-0f7a-4221-b0c5-3e3bdd85c9be service nova] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:00.437201 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-75b77555-8eaf-459d-90ab-25f58dbb17a4 req-9d34289e-0f7a-4221-b0c5-3e3bdd85c9be service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:00.437833 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-75b77555-8eaf-459d-90ab-25f58dbb17a4 req-9d34289e-0f7a-4221-b0c5-3e3bdd85c9be service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:00.450331 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.compute.server_external_events [req-75b77555-8eaf-459d-90ab-25f58dbb17a4 req-9d34289e-0f7a-4221-b0c5-3e3bdd85c9be service nova] Creating event network-vif-plugged:8c960645-780e-4056-84f6-f734369fcc20 for instance 6dffef84-3605-422f-ac42-8c1614b24539 on hv-cinder-84630 Aug 27 02:22:00.456481 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [req-75b77555-8eaf-459d-90ab-25f58dbb17a4 req-9d34289e-0f7a-4221-b0c5-3e3bdd85c9be service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033262 Aug 27 02:22:00.457068 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 90/183] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Aug 27 02:22:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:22:00.851254 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-35a06a56-83db-42ef-aaab-6a60c66d58c9 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:00.851254 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-35a06a56-83db-42ef-aaab-6a60c66d58c9 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] [instance: 6dffef84-3605-422f-ac42-8c1614b24539] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:00.856412 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-35a06a56-83db-42ef-aaab-6a60c66d58c9 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:00.856913 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-35a06a56-83db-42ef-aaab-6a60c66d58c9 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:00.857358 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-35a06a56-83db-42ef-aaab-6a60c66d58c9 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:00.858100 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-35a06a56-83db-42ef-aaab-6a60c66d58c9 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:00.858709 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-35a06a56-83db-42ef-aaab-6a60c66d58c9 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:00.859236 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-35a06a56-83db-42ef-aaab-6a60c66d58c9 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:01.015665 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-35a06a56-83db-42ef-aaab-6a60c66d58c9 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc3be23405d4ae88dd46d656ad6a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc715590f88432d9b6e7dd779ad5851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:01.026649 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-35a06a56-83db-42ef-aaab-6a60c66d58c9 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] 10.222.0.61 "GET /compute/v2.1/servers/6dffef84-3605-422f-ac42-8c1614b24539" status: 200 len: 1312 microversion: 2.1 time: 0.184276 Aug 27 02:22:01.028077 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 94/184] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:22:00 2022] GET /compute/v2.1/servers/6dffef84-3605-422f-ac42-8c1614b24539 => generated 1312 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:22:01.098135 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-41a5ec22-db88-40c3-ba1e-2865f60892ba tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:01.098135 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-41a5ec22-db88-40c3-ba1e-2865f60892ba tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] [instance: 286c8683-8bd6-4dcc-8540-cc73dd752da5] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:01.109959 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-41a5ec22-db88-40c3-ba1e-2865f60892ba tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:01.110839 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-41a5ec22-db88-40c3-ba1e-2865f60892ba tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:01.111582 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-41a5ec22-db88-40c3-ba1e-2865f60892ba tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:01.112810 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-41a5ec22-db88-40c3-ba1e-2865f60892ba tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:01.113652 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-41a5ec22-db88-40c3-ba1e-2865f60892ba tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:01.114598 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-41a5ec22-db88-40c3-ba1e-2865f60892ba tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:01.266363 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-2f2e32ae-59de-4ee5-a17d-ab68a52c6076 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:01.268013 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-2f2e32ae-59de-4ee5-a17d-ab68a52c6076 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 5cbe7ad9-5124-4014-9d2a-e877493b2a9e] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:01.284613 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2f2e32ae-59de-4ee5-a17d-ab68a52c6076 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:01.285667 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2f2e32ae-59de-4ee5-a17d-ab68a52c6076 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:01.286273 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2f2e32ae-59de-4ee5-a17d-ab68a52c6076 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:01.287454 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2f2e32ae-59de-4ee5-a17d-ab68a52c6076 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:01.288725 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-41a5ec22-db88-40c3-ba1e-2865f60892ba tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3800f9c3071b4c908b4d378c69953228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74107e05cf1644fc805625368fca2cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:01.292200 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2f2e32ae-59de-4ee5-a17d-ab68a52c6076 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:01.292909 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2f2e32ae-59de-4ee5-a17d-ab68a52c6076 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:01.301770 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-41a5ec22-db88-40c3-ba1e-2865f60892ba tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] 10.222.0.61 "GET /compute/v2.1/servers/286c8683-8bd6-4dcc-8540-cc73dd752da5" status: 200 len: 1315 microversion: 2.1 time: 0.214742 Aug 27 02:22:01.302940 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 91/185] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:22:01 2022] GET /compute/v2.1/servers/286c8683-8bd6-4dcc-8540-cc73dd752da5 => generated 1315 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:22:01.736187 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-2f2e32ae-59de-4ee5-a17d-ab68a52c6076 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:01.745449 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-2f2e32ae-59de-4ee5-a17d-ab68a52c6076 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e" status: 200 len: 1522 microversion: 2.1 time: 0.486655 Aug 27 02:22:01.746259 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 95/186] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:22:01 2022] GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e => generated 1522 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:22:02.060578 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-dbefc374-3308-46a6-bee2-6fb51db5bf3b tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:02.061201 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-dbefc374-3308-46a6-bee2-6fb51db5bf3b tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] [instance: 6dffef84-3605-422f-ac42-8c1614b24539] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:02.067720 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-dbefc374-3308-46a6-bee2-6fb51db5bf3b tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:02.068303 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-dbefc374-3308-46a6-bee2-6fb51db5bf3b tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:02.068740 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-dbefc374-3308-46a6-bee2-6fb51db5bf3b tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:02.069483 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-dbefc374-3308-46a6-bee2-6fb51db5bf3b tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:02.070002 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-dbefc374-3308-46a6-bee2-6fb51db5bf3b tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:02.070427 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-dbefc374-3308-46a6-bee2-6fb51db5bf3b tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:02.265088 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-dbefc374-3308-46a6-bee2-6fb51db5bf3b tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc3be23405d4ae88dd46d656ad6a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc715590f88432d9b6e7dd779ad5851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:02.280815 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-dbefc374-3308-46a6-bee2-6fb51db5bf3b tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] 10.222.0.61 "GET /compute/v2.1/servers/6dffef84-3605-422f-ac42-8c1614b24539" status: 200 len: 1312 microversion: 2.1 time: 0.224997 Aug 27 02:22:02.283200 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 92/187] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:22:02 2022] GET /compute/v2.1/servers/6dffef84-3605-422f-ac42-8c1614b24539 => generated 1312 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:22:02.342256 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-adfd44e7-dda2-42a7-8ff3-6647a66488d6 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:02.343644 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-adfd44e7-dda2-42a7-8ff3-6647a66488d6 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] [instance: 286c8683-8bd6-4dcc-8540-cc73dd752da5] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:02.370916 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-adfd44e7-dda2-42a7-8ff3-6647a66488d6 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:02.372093 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-adfd44e7-dda2-42a7-8ff3-6647a66488d6 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:02.377190 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-adfd44e7-dda2-42a7-8ff3-6647a66488d6 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:02.379574 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-adfd44e7-dda2-42a7-8ff3-6647a66488d6 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:02.384285 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-adfd44e7-dda2-42a7-8ff3-6647a66488d6 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:02.384784 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-adfd44e7-dda2-42a7-8ff3-6647a66488d6 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:02.597751 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-adfd44e7-dda2-42a7-8ff3-6647a66488d6 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3800f9c3071b4c908b4d378c69953228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74107e05cf1644fc805625368fca2cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:02.610375 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-adfd44e7-dda2-42a7-8ff3-6647a66488d6 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] 10.222.0.61 "GET /compute/v2.1/servers/286c8683-8bd6-4dcc-8540-cc73dd752da5" status: 200 len: 1315 microversion: 2.1 time: 0.278595 Aug 27 02:22:02.621343 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 96/188] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:22:02 2022] GET /compute/v2.1/servers/286c8683-8bd6-4dcc-8540-cc73dd752da5 => generated 1315 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:22:02.773104 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-bee88987-8d5a-41c6-a139-c4325d6adf3b tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:02.774265 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-bee88987-8d5a-41c6-a139-c4325d6adf3b tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 5cbe7ad9-5124-4014-9d2a-e877493b2a9e] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:02.785563 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bee88987-8d5a-41c6-a139-c4325d6adf3b tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:02.786813 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bee88987-8d5a-41c6-a139-c4325d6adf3b tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:02.787544 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bee88987-8d5a-41c6-a139-c4325d6adf3b tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:02.789286 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bee88987-8d5a-41c6-a139-c4325d6adf3b tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:02.790158 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bee88987-8d5a-41c6-a139-c4325d6adf3b tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:02.790915 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bee88987-8d5a-41c6-a139-c4325d6adf3b tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:02.988793 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-bee88987-8d5a-41c6-a139-c4325d6adf3b tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:02.999042 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-bee88987-8d5a-41c6-a139-c4325d6adf3b tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e" status: 200 len: 1522 microversion: 2.1 time: 0.234371 Aug 27 02:22:02.999751 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 93/189] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:22:02 2022] GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e => generated 1522 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:22:03.304542 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-6ddc65aa-ab25-4ba3-90f8-4d468a9b3e71 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:03.305282 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-6ddc65aa-ab25-4ba3-90f8-4d468a9b3e71 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] [instance: 6dffef84-3605-422f-ac42-8c1614b24539] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:03.321248 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6ddc65aa-ab25-4ba3-90f8-4d468a9b3e71 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:03.321769 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6ddc65aa-ab25-4ba3-90f8-4d468a9b3e71 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:03.322200 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6ddc65aa-ab25-4ba3-90f8-4d468a9b3e71 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:03.322917 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6ddc65aa-ab25-4ba3-90f8-4d468a9b3e71 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:03.323365 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6ddc65aa-ab25-4ba3-90f8-4d468a9b3e71 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:03.323789 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6ddc65aa-ab25-4ba3-90f8-4d468a9b3e71 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:03.529709 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-6ddc65aa-ab25-4ba3-90f8-4d468a9b3e71 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc3be23405d4ae88dd46d656ad6a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc715590f88432d9b6e7dd779ad5851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:03.541807 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-6ddc65aa-ab25-4ba3-90f8-4d468a9b3e71 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] 10.222.0.61 "GET /compute/v2.1/servers/6dffef84-3605-422f-ac42-8c1614b24539" status: 200 len: 1495 microversion: 2.1 time: 0.241688 Aug 27 02:22:03.542496 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 97/190] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:22:03 2022] GET /compute/v2.1/servers/6dffef84-3605-422f-ac42-8c1614b24539 => generated 1495 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:22:03.634295 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-a7a5572a-6349-4cbb-8cef-5cb9005db5cf tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:03.635742 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-a7a5572a-6349-4cbb-8cef-5cb9005db5cf tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] [instance: 286c8683-8bd6-4dcc-8540-cc73dd752da5] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:03.644964 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a7a5572a-6349-4cbb-8cef-5cb9005db5cf tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:03.645908 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a7a5572a-6349-4cbb-8cef-5cb9005db5cf tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:03.646502 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a7a5572a-6349-4cbb-8cef-5cb9005db5cf tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:03.647906 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a7a5572a-6349-4cbb-8cef-5cb9005db5cf tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:03.648716 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a7a5572a-6349-4cbb-8cef-5cb9005db5cf tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:03.649290 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a7a5572a-6349-4cbb-8cef-5cb9005db5cf tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:03.818050 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-a7a5572a-6349-4cbb-8cef-5cb9005db5cf tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3800f9c3071b4c908b4d378c69953228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74107e05cf1644fc805625368fca2cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:03.833375 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-a7a5572a-6349-4cbb-8cef-5cb9005db5cf tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] 10.222.0.61 "GET /compute/v2.1/servers/286c8683-8bd6-4dcc-8540-cc73dd752da5" status: 200 len: 1315 microversion: 2.1 time: 0.205435 Aug 27 02:22:03.834855 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 94/191] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:22:03 2022] GET /compute/v2.1/servers/286c8683-8bd6-4dcc-8540-cc73dd752da5 => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:22:04.022914 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-be4e4a07-4671-4752-b064-518900863e5c tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:04.023539 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-be4e4a07-4671-4752-b064-518900863e5c tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 5cbe7ad9-5124-4014-9d2a-e877493b2a9e] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:04.034948 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-be4e4a07-4671-4752-b064-518900863e5c tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:04.035617 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-be4e4a07-4671-4752-b064-518900863e5c tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:04.036211 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-be4e4a07-4671-4752-b064-518900863e5c tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:04.037075 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-be4e4a07-4671-4752-b064-518900863e5c tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:04.037863 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-be4e4a07-4671-4752-b064-518900863e5c tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:04.038446 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-be4e4a07-4671-4752-b064-518900863e5c tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:04.325950 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-be4e4a07-4671-4752-b064-518900863e5c tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:04.335400 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-be4e4a07-4671-4752-b064-518900863e5c tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e" status: 200 len: 1522 microversion: 2.1 time: 0.318037 Aug 27 02:22:04.336905 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 98/192] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:22:04 2022] GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e => generated 1522 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:22:04.569697 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [req-50cbd3ba-b904-40b8-aef5-c59d61746684 req-457c4c8b-8797-4fb9-b5d5-04448313e39d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "286c8683-8bd6-4dcc-8540-cc73dd752da5", "name": "network-vif-plugged", "status": "completed", "tag": "c5ece479-76ab-48fe-baaa-f787a33a55f7"}]} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:22:04.587736 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-50cbd3ba-b904-40b8-aef5-c59d61746684 req-457c4c8b-8797-4fb9-b5d5-04448313e39d service nova] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:04.588227 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-50cbd3ba-b904-40b8-aef5-c59d61746684 req-457c4c8b-8797-4fb9-b5d5-04448313e39d service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:04.588657 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-50cbd3ba-b904-40b8-aef5-c59d61746684 req-457c4c8b-8797-4fb9-b5d5-04448313e39d service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:04.612416 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.compute.server_external_events [req-50cbd3ba-b904-40b8-aef5-c59d61746684 req-457c4c8b-8797-4fb9-b5d5-04448313e39d service nova] Creating event network-vif-plugged:c5ece479-76ab-48fe-baaa-f787a33a55f7 for instance 286c8683-8bd6-4dcc-8540-cc73dd752da5 on hv-cinder-84630 Aug 27 02:22:04.623777 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [req-50cbd3ba-b904-40b8-aef5-c59d61746684 req-457c4c8b-8797-4fb9-b5d5-04448313e39d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057800 Aug 27 02:22:04.626561 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 95/193] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Aug 27 02:22:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:22:04.860070 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-c839911c-5ba3-4a6e-95ae-9e971dbd0a6b tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:04.862232 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-c839911c-5ba3-4a6e-95ae-9e971dbd0a6b tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] [instance: 286c8683-8bd6-4dcc-8540-cc73dd752da5] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:04.872282 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c839911c-5ba3-4a6e-95ae-9e971dbd0a6b tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:04.873063 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c839911c-5ba3-4a6e-95ae-9e971dbd0a6b tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:04.873701 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c839911c-5ba3-4a6e-95ae-9e971dbd0a6b tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:04.874951 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c839911c-5ba3-4a6e-95ae-9e971dbd0a6b tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:04.875684 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c839911c-5ba3-4a6e-95ae-9e971dbd0a6b tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:04.876299 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c839911c-5ba3-4a6e-95ae-9e971dbd0a6b tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:05.073749 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-c839911c-5ba3-4a6e-95ae-9e971dbd0a6b tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3800f9c3071b4c908b4d378c69953228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74107e05cf1644fc805625368fca2cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:05.089032 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-c839911c-5ba3-4a6e-95ae-9e971dbd0a6b tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] 10.222.0.61 "GET /compute/v2.1/servers/286c8683-8bd6-4dcc-8540-cc73dd752da5" status: 200 len: 1315 microversion: 2.1 time: 0.236478 Aug 27 02:22:05.101846 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 99/194] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:22:04 2022] GET /compute/v2.1/servers/286c8683-8bd6-4dcc-8540-cc73dd752da5 => generated 1315 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:22:05.357977 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-5f046286-d6d2-4edd-a050-902a6017695e tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:05.358853 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-5f046286-d6d2-4edd-a050-902a6017695e tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 5cbe7ad9-5124-4014-9d2a-e877493b2a9e] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:05.371094 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5f046286-d6d2-4edd-a050-902a6017695e tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:05.376564 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5f046286-d6d2-4edd-a050-902a6017695e tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:05.377450 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5f046286-d6d2-4edd-a050-902a6017695e tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:05.378579 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5f046286-d6d2-4edd-a050-902a6017695e tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:05.379573 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5f046286-d6d2-4edd-a050-902a6017695e tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:05.380002 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5f046286-d6d2-4edd-a050-902a6017695e tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:05.579917 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-5f046286-d6d2-4edd-a050-902a6017695e tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:05.592013 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-5f046286-d6d2-4edd-a050-902a6017695e tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e" status: 200 len: 1522 microversion: 2.1 time: 0.238463 Aug 27 02:22:05.605428 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 96/195] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:22:05 2022] GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e => generated 1522 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:22:06.143468 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-1ce98fbc-b3c3-4a0c-a8fe-389d7f7ca0a6 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:06.144085 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-1ce98fbc-b3c3-4a0c-a8fe-389d7f7ca0a6 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] [instance: 286c8683-8bd6-4dcc-8540-cc73dd752da5] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:06.148032 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:22:06.155497 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1ce98fbc-b3c3-4a0c-a8fe-389d7f7ca0a6 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:06.156138 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1ce98fbc-b3c3-4a0c-a8fe-389d7f7ca0a6 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:06.156631 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1ce98fbc-b3c3-4a0c-a8fe-389d7f7ca0a6 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:06.157644 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1ce98fbc-b3c3-4a0c-a8fe-389d7f7ca0a6 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:06.157927 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1ce98fbc-b3c3-4a0c-a8fe-389d7f7ca0a6 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:06.158614 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1ce98fbc-b3c3-4a0c-a8fe-389d7f7ca0a6 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:06.353803 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-1ce98fbc-b3c3-4a0c-a8fe-389d7f7ca0a6 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3800f9c3071b4c908b4d378c69953228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74107e05cf1644fc805625368fca2cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:06.367313 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-1ce98fbc-b3c3-4a0c-a8fe-389d7f7ca0a6 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] 10.222.0.61 "GET /compute/v2.1/servers/286c8683-8bd6-4dcc-8540-cc73dd752da5" status: 200 len: 1315 microversion: 2.1 time: 0.227647 Aug 27 02:22:06.368313 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 100/196] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:22:06 2022] GET /compute/v2.1/servers/286c8683-8bd6-4dcc-8540-cc73dd752da5 => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:22:06.615185 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-c5c799a2-8a8b-416b-afe8-093761ed6a54 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:06.615890 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-c5c799a2-8a8b-416b-afe8-093761ed6a54 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 5cbe7ad9-5124-4014-9d2a-e877493b2a9e] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:06.623565 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c5c799a2-8a8b-416b-afe8-093761ed6a54 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:06.624388 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c5c799a2-8a8b-416b-afe8-093761ed6a54 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:06.625026 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c5c799a2-8a8b-416b-afe8-093761ed6a54 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:06.625854 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c5c799a2-8a8b-416b-afe8-093761ed6a54 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:06.626728 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c5c799a2-8a8b-416b-afe8-093761ed6a54 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:06.627343 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c5c799a2-8a8b-416b-afe8-093761ed6a54 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:06.747034 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-a0c40bbd-3525-447c-afda-16af7eb8a711 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:06.748138 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-a0c40bbd-3525-447c-afda-16af7eb8a711 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] [instance: 6dffef84-3605-422f-ac42-8c1614b24539] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:06.763220 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a0c40bbd-3525-447c-afda-16af7eb8a711 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:06.764527 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a0c40bbd-3525-447c-afda-16af7eb8a711 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:06.765609 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a0c40bbd-3525-447c-afda-16af7eb8a711 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:06.767910 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a0c40bbd-3525-447c-afda-16af7eb8a711 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:06.768865 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a0c40bbd-3525-447c-afda-16af7eb8a711 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:06.770548 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a0c40bbd-3525-447c-afda-16af7eb8a711 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:06.843686 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-a0c40bbd-3525-447c-afda-16af7eb8a711 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] [instance: 6dffef84-3605-422f-ac42-8c1614b24539] Going to try to terminate instance {{(pid=120782) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:22:06.865870 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-c5c799a2-8a8b-416b-afe8-093761ed6a54 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:06.879979 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-c5c799a2-8a8b-416b-afe8-093761ed6a54 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e" status: 200 len: 1522 microversion: 2.1 time: 0.268837 Aug 27 02:22:06.880936 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 97/197] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:22:06 2022] GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e => generated 1522 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:22:06.970864 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-a0c40bbd-3525-447c-afda-16af7eb8a711 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] 10.222.0.61 "DELETE /compute/v2.1/servers/6dffef84-3605-422f-ac42-8c1614b24539" status: 204 len: 0 microversion: 2.1 time: 0.233263 Aug 27 02:22:06.971586 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 101/198] 10.222.0.61 () {58 vars in 1239 bytes} [Sat Aug 27 02:22:06 2022] DELETE /compute/v2.1/servers/6dffef84-3605-422f-ac42-8c1614b24539 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:22:06.984778 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-a2ce1cdd-e160-4c28-ab6d-8728510ed1eb tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:06.986291 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-a2ce1cdd-e160-4c28-ab6d-8728510ed1eb tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] [instance: 6dffef84-3605-422f-ac42-8c1614b24539] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:06.996542 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a2ce1cdd-e160-4c28-ab6d-8728510ed1eb tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:06.997165 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a2ce1cdd-e160-4c28-ab6d-8728510ed1eb tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:06.998283 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a2ce1cdd-e160-4c28-ab6d-8728510ed1eb tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:06.999088 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a2ce1cdd-e160-4c28-ab6d-8728510ed1eb tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:06.999647 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a2ce1cdd-e160-4c28-ab6d-8728510ed1eb tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:07.000373 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a2ce1cdd-e160-4c28-ab6d-8728510ed1eb tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:07.164697 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-a2ce1cdd-e160-4c28-ab6d-8728510ed1eb tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc3be23405d4ae88dd46d656ad6a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc715590f88432d9b6e7dd779ad5851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:07.178059 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-a2ce1cdd-e160-4c28-ab6d-8728510ed1eb tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] 10.222.0.61 "GET /compute/v2.1/servers/6dffef84-3605-422f-ac42-8c1614b24539" status: 200 len: 1501 microversion: 2.1 time: 0.201051 Aug 27 02:22:07.179003 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 98/199] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:22:06 2022] GET /compute/v2.1/servers/6dffef84-3605-422f-ac42-8c1614b24539 => generated 1501 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:22:07.411419 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-0d313c1a-e264-4df7-a543-5ff2486e982b tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:07.412211 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-0d313c1a-e264-4df7-a543-5ff2486e982b tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] [instance: 286c8683-8bd6-4dcc-8540-cc73dd752da5] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:07.423173 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0d313c1a-e264-4df7-a543-5ff2486e982b tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:07.423801 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0d313c1a-e264-4df7-a543-5ff2486e982b tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:07.426066 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0d313c1a-e264-4df7-a543-5ff2486e982b tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:07.427073 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0d313c1a-e264-4df7-a543-5ff2486e982b tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:07.427884 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0d313c1a-e264-4df7-a543-5ff2486e982b tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:07.428397 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0d313c1a-e264-4df7-a543-5ff2486e982b tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:07.600182 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-0d313c1a-e264-4df7-a543-5ff2486e982b tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3800f9c3071b4c908b4d378c69953228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74107e05cf1644fc805625368fca2cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:07.615028 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-0d313c1a-e264-4df7-a543-5ff2486e982b tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] 10.222.0.61 "GET /compute/v2.1/servers/286c8683-8bd6-4dcc-8540-cc73dd752da5" status: 200 len: 1465 microversion: 2.1 time: 0.209578 Aug 27 02:22:07.616048 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 102/200] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:22:07 2022] GET /compute/v2.1/servers/286c8683-8bd6-4dcc-8540-cc73dd752da5 => generated 1465 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:22:07.670330 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-09538dfd-04f8-40c3-a0c7-5aa408e73323 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:07.671240 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-09538dfd-04f8-40c3-a0c7-5aa408e73323 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] [instance: 286c8683-8bd6-4dcc-8540-cc73dd752da5] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:07.679763 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-09538dfd-04f8-40c3-a0c7-5aa408e73323 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:07.680735 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-09538dfd-04f8-40c3-a0c7-5aa408e73323 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:07.681284 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-09538dfd-04f8-40c3-a0c7-5aa408e73323 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:07.682124 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-09538dfd-04f8-40c3-a0c7-5aa408e73323 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:07.682727 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-09538dfd-04f8-40c3-a0c7-5aa408e73323 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:07.683235 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-09538dfd-04f8-40c3-a0c7-5aa408e73323 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:07.704212 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell1:SELECT=100 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:22:07.712779 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-09538dfd-04f8-40c3-a0c7-5aa408e73323 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] [instance: 286c8683-8bd6-4dcc-8540-cc73dd752da5] Going to try to terminate instance {{(pid=120783) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:22:07.806826 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-09538dfd-04f8-40c3-a0c7-5aa408e73323 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] 10.222.0.61 "DELETE /compute/v2.1/servers/286c8683-8bd6-4dcc-8540-cc73dd752da5" status: 204 len: 0 microversion: 2.1 time: 0.141444 Aug 27 02:22:07.807422 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 99/201] 10.222.0.61 () {58 vars in 1239 bytes} [Sat Aug 27 02:22:07 2022] DELETE /compute/v2.1/servers/286c8683-8bd6-4dcc-8540-cc73dd752da5 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:22:07.816183 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-6b902396-f085-4e1f-b7f0-c355e360e46f tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:07.816801 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-6b902396-f085-4e1f-b7f0-c355e360e46f tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] [instance: 286c8683-8bd6-4dcc-8540-cc73dd752da5] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:07.823638 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6b902396-f085-4e1f-b7f0-c355e360e46f tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:07.824421 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6b902396-f085-4e1f-b7f0-c355e360e46f tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:07.824912 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6b902396-f085-4e1f-b7f0-c355e360e46f tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:07.826020 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6b902396-f085-4e1f-b7f0-c355e360e46f tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:07.826703 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6b902396-f085-4e1f-b7f0-c355e360e46f tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:07.827225 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6b902396-f085-4e1f-b7f0-c355e360e46f tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:07.928085 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-202eca81-b0d6-4d47-95a0-10b167dd6a0c tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:07.938333 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-202eca81-b0d6-4d47-95a0-10b167dd6a0c tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 5cbe7ad9-5124-4014-9d2a-e877493b2a9e] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:07.945082 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-202eca81-b0d6-4d47-95a0-10b167dd6a0c tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:07.945836 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-202eca81-b0d6-4d47-95a0-10b167dd6a0c tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:07.946525 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-202eca81-b0d6-4d47-95a0-10b167dd6a0c tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:07.947356 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-202eca81-b0d6-4d47-95a0-10b167dd6a0c tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:07.947919 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-202eca81-b0d6-4d47-95a0-10b167dd6a0c tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:07.948443 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-202eca81-b0d6-4d47-95a0-10b167dd6a0c tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:08.021345 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-6b902396-f085-4e1f-b7f0-c355e360e46f tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3800f9c3071b4c908b4d378c69953228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74107e05cf1644fc805625368fca2cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:08.032643 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-6b902396-f085-4e1f-b7f0-c355e360e46f tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] 10.222.0.61 "GET /compute/v2.1/servers/286c8683-8bd6-4dcc-8540-cc73dd752da5" status: 200 len: 1471 microversion: 2.1 time: 0.220431 Aug 27 02:22:08.033568 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 103/202] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:22:07 2022] GET /compute/v2.1/servers/286c8683-8bd6-4dcc-8540-cc73dd752da5 => generated 1471 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:22:08.127796 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-202eca81-b0d6-4d47-95a0-10b167dd6a0c tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:08.137026 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-202eca81-b0d6-4d47-95a0-10b167dd6a0c tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e" status: 200 len: 1522 microversion: 2.1 time: 0.218984 Aug 27 02:22:08.137725 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 100/203] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:22:07 2022] GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:22:08.215914 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-76f1bd2a-c736-4cdf-94f8-13f8b58026b5 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:08.216982 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-76f1bd2a-c736-4cdf-94f8-13f8b58026b5 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] [instance: 6dffef84-3605-422f-ac42-8c1614b24539] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:08.228437 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-76f1bd2a-c736-4cdf-94f8-13f8b58026b5 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:08.229298 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-76f1bd2a-c736-4cdf-94f8-13f8b58026b5 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:08.230090 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-76f1bd2a-c736-4cdf-94f8-13f8b58026b5 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:08.231073 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-76f1bd2a-c736-4cdf-94f8-13f8b58026b5 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:08.231962 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-76f1bd2a-c736-4cdf-94f8-13f8b58026b5 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:08.232724 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-76f1bd2a-c736-4cdf-94f8-13f8b58026b5 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:08.442777 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-76f1bd2a-c736-4cdf-94f8-13f8b58026b5 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc3be23405d4ae88dd46d656ad6a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc715590f88432d9b6e7dd779ad5851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:08.453025 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-76f1bd2a-c736-4cdf-94f8-13f8b58026b5 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] 10.222.0.61 "GET /compute/v2.1/servers/6dffef84-3605-422f-ac42-8c1614b24539" status: 200 len: 1501 microversion: 2.1 time: 0.244632 Aug 27 02:22:08.453904 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 104/204] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:22:08 2022] GET /compute/v2.1/servers/6dffef84-3605-422f-ac42-8c1614b24539 => generated 1501 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:22:09.065881 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-77437d5f-c02b-4d0b-8936-1e88ecd1374e tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:09.066781 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-77437d5f-c02b-4d0b-8936-1e88ecd1374e tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] [instance: 286c8683-8bd6-4dcc-8540-cc73dd752da5] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:09.074622 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-77437d5f-c02b-4d0b-8936-1e88ecd1374e tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:09.075432 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-77437d5f-c02b-4d0b-8936-1e88ecd1374e tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:09.076002 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-77437d5f-c02b-4d0b-8936-1e88ecd1374e tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:09.077181 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-77437d5f-c02b-4d0b-8936-1e88ecd1374e tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:09.077959 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-77437d5f-c02b-4d0b-8936-1e88ecd1374e tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:09.078475 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-77437d5f-c02b-4d0b-8936-1e88ecd1374e tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:09.167659 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-72fd28aa-262f-4d58-a9b8-1bfc3ed1b302 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:09.170802 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-72fd28aa-262f-4d58-a9b8-1bfc3ed1b302 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 5cbe7ad9-5124-4014-9d2a-e877493b2a9e] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:09.205156 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-72fd28aa-262f-4d58-a9b8-1bfc3ed1b302 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:09.206776 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-72fd28aa-262f-4d58-a9b8-1bfc3ed1b302 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:09.208194 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-72fd28aa-262f-4d58-a9b8-1bfc3ed1b302 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:09.213882 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-72fd28aa-262f-4d58-a9b8-1bfc3ed1b302 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:09.215533 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-72fd28aa-262f-4d58-a9b8-1bfc3ed1b302 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:09.216475 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-72fd28aa-262f-4d58-a9b8-1bfc3ed1b302 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:09.253189 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:22:09.277747 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-77437d5f-c02b-4d0b-8936-1e88ecd1374e tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3800f9c3071b4c908b4d378c69953228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74107e05cf1644fc805625368fca2cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:09.288552 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-77437d5f-c02b-4d0b-8936-1e88ecd1374e tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] 10.222.0.61 "GET /compute/v2.1/servers/286c8683-8bd6-4dcc-8540-cc73dd752da5" status: 200 len: 1471 microversion: 2.1 time: 0.227304 Aug 27 02:22:09.289322 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 101/205] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:22:09 2022] GET /compute/v2.1/servers/286c8683-8bd6-4dcc-8540-cc73dd752da5 => generated 1471 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:22:09.421818 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-72fd28aa-262f-4d58-a9b8-1bfc3ed1b302 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:09.437631 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-72fd28aa-262f-4d58-a9b8-1bfc3ed1b302 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e" status: 200 len: 1522 microversion: 2.1 time: 0.279498 Aug 27 02:22:09.438918 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 105/206] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:22:09 2022] GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e => generated 1522 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:22:09.484848 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-0c29aca4-6098-4299-ae68-61d13840a48b tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:09.486161 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-0c29aca4-6098-4299-ae68-61d13840a48b tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] [instance: 6dffef84-3605-422f-ac42-8c1614b24539] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:09.496464 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0c29aca4-6098-4299-ae68-61d13840a48b tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:09.497708 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0c29aca4-6098-4299-ae68-61d13840a48b tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:09.498591 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0c29aca4-6098-4299-ae68-61d13840a48b tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:09.500064 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0c29aca4-6098-4299-ae68-61d13840a48b tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:09.500891 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0c29aca4-6098-4299-ae68-61d13840a48b tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:09.501605 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0c29aca4-6098-4299-ae68-61d13840a48b tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:09.665167 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-0c29aca4-6098-4299-ae68-61d13840a48b tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc3be23405d4ae88dd46d656ad6a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc715590f88432d9b6e7dd779ad5851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:09.674326 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-0c29aca4-6098-4299-ae68-61d13840a48b tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] 10.222.0.61 "GET /compute/v2.1/servers/6dffef84-3605-422f-ac42-8c1614b24539" status: 200 len: 1501 microversion: 2.1 time: 0.196791 Aug 27 02:22:09.674911 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 102/207] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:22:09 2022] GET /compute/v2.1/servers/6dffef84-3605-422f-ac42-8c1614b24539 => generated 1501 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:22:10.314540 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-6325d315-0e48-4eb0-ae3c-4f77c83be22b tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:10.315765 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-6325d315-0e48-4eb0-ae3c-4f77c83be22b tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] [instance: 286c8683-8bd6-4dcc-8540-cc73dd752da5] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:10.325786 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6325d315-0e48-4eb0-ae3c-4f77c83be22b tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:10.326634 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6325d315-0e48-4eb0-ae3c-4f77c83be22b tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:10.327243 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6325d315-0e48-4eb0-ae3c-4f77c83be22b tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:10.328268 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6325d315-0e48-4eb0-ae3c-4f77c83be22b tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:10.328792 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6325d315-0e48-4eb0-ae3c-4f77c83be22b tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:10.329421 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6325d315-0e48-4eb0-ae3c-4f77c83be22b tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:10.464103 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-325d048f-b5b6-4a65-9bda-50646d0ecebf tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:10.465219 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-325d048f-b5b6-4a65-9bda-50646d0ecebf tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 5cbe7ad9-5124-4014-9d2a-e877493b2a9e] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:10.480050 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-325d048f-b5b6-4a65-9bda-50646d0ecebf tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:10.481069 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-325d048f-b5b6-4a65-9bda-50646d0ecebf tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:10.482767 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-325d048f-b5b6-4a65-9bda-50646d0ecebf tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:10.484102 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-325d048f-b5b6-4a65-9bda-50646d0ecebf tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:10.484849 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-325d048f-b5b6-4a65-9bda-50646d0ecebf tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:10.485555 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-325d048f-b5b6-4a65-9bda-50646d0ecebf tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:10.497871 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-6325d315-0e48-4eb0-ae3c-4f77c83be22b tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3800f9c3071b4c908b4d378c69953228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74107e05cf1644fc805625368fca2cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:10.512024 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-6325d315-0e48-4eb0-ae3c-4f77c83be22b tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] 10.222.0.61 "GET /compute/v2.1/servers/286c8683-8bd6-4dcc-8540-cc73dd752da5" status: 200 len: 1471 microversion: 2.1 time: 0.204230 Aug 27 02:22:10.529627 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 106/208] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:22:10 2022] GET /compute/v2.1/servers/286c8683-8bd6-4dcc-8540-cc73dd752da5 => generated 1471 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:22:10.661858 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-325d048f-b5b6-4a65-9bda-50646d0ecebf tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:10.672161 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-325d048f-b5b6-4a65-9bda-50646d0ecebf tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e" status: 200 len: 1522 microversion: 2.1 time: 0.214616 Aug 27 02:22:10.672639 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 103/209] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:22:10 2022] GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:22:10.700807 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-01d8af83-8007-4bf0-aa10-f15b36f1e7d1 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:10.701848 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-01d8af83-8007-4bf0-aa10-f15b36f1e7d1 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] [instance: 6dffef84-3605-422f-ac42-8c1614b24539] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:10.711392 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-01d8af83-8007-4bf0-aa10-f15b36f1e7d1 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:10.712181 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-01d8af83-8007-4bf0-aa10-f15b36f1e7d1 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:10.712900 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-01d8af83-8007-4bf0-aa10-f15b36f1e7d1 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:10.714018 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-01d8af83-8007-4bf0-aa10-f15b36f1e7d1 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:10.714999 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-01d8af83-8007-4bf0-aa10-f15b36f1e7d1 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:10.715728 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-01d8af83-8007-4bf0-aa10-f15b36f1e7d1 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:10.895288 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-01d8af83-8007-4bf0-aa10-f15b36f1e7d1 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc3be23405d4ae88dd46d656ad6a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc715590f88432d9b6e7dd779ad5851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:10.904202 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-01d8af83-8007-4bf0-aa10-f15b36f1e7d1 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] 10.222.0.61 "GET /compute/v2.1/servers/6dffef84-3605-422f-ac42-8c1614b24539" status: 200 len: 1501 microversion: 2.1 time: 0.209630 Aug 27 02:22:10.904752 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 107/210] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:22:10 2022] GET /compute/v2.1/servers/6dffef84-3605-422f-ac42-8c1614b24539 => generated 1501 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:22:11.536841 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-8a43e858-e1d9-4873-a363-df4a62581a09 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:11.537542 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-8a43e858-e1d9-4873-a363-df4a62581a09 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] [instance: 286c8683-8bd6-4dcc-8540-cc73dd752da5] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:11.545187 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8a43e858-e1d9-4873-a363-df4a62581a09 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:11.545718 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8a43e858-e1d9-4873-a363-df4a62581a09 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:11.546168 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8a43e858-e1d9-4873-a363-df4a62581a09 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:11.546975 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8a43e858-e1d9-4873-a363-df4a62581a09 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:11.547425 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8a43e858-e1d9-4873-a363-df4a62581a09 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:11.547844 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8a43e858-e1d9-4873-a363-df4a62581a09 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:11.694705 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-8a43e858-e1d9-4873-a363-df4a62581a09 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3800f9c3071b4c908b4d378c69953228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74107e05cf1644fc805625368fca2cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:11.694964 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-3e207ca8-7abc-4601-abdd-980e02937aa0 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:11.695659 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-3e207ca8-7abc-4601-abdd-980e02937aa0 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 5cbe7ad9-5124-4014-9d2a-e877493b2a9e] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:11.702091 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3e207ca8-7abc-4601-abdd-980e02937aa0 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:11.702504 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3e207ca8-7abc-4601-abdd-980e02937aa0 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:11.702928 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3e207ca8-7abc-4601-abdd-980e02937aa0 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:11.703622 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3e207ca8-7abc-4601-abdd-980e02937aa0 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:11.704070 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3e207ca8-7abc-4601-abdd-980e02937aa0 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:11.704489 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3e207ca8-7abc-4601-abdd-980e02937aa0 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:11.705201 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-8a43e858-e1d9-4873-a363-df4a62581a09 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] 10.222.0.61 "GET /compute/v2.1/servers/286c8683-8bd6-4dcc-8540-cc73dd752da5" status: 200 len: 1471 microversion: 2.1 time: 0.172387 Aug 27 02:22:11.705948 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 104/211] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:22:11 2022] GET /compute/v2.1/servers/286c8683-8bd6-4dcc-8540-cc73dd752da5 => generated 1471 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:22:11.936329 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-9bb3a2be-e6c8-4f26-981e-08e64aa55e27 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:11.937354 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-9bb3a2be-e6c8-4f26-981e-08e64aa55e27 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] [instance: 6dffef84-3605-422f-ac42-8c1614b24539] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:11.944435 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-3e207ca8-7abc-4601-abdd-980e02937aa0 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:11.944665 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9bb3a2be-e6c8-4f26-981e-08e64aa55e27 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:11.945425 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9bb3a2be-e6c8-4f26-981e-08e64aa55e27 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:11.946290 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9bb3a2be-e6c8-4f26-981e-08e64aa55e27 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:11.948292 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9bb3a2be-e6c8-4f26-981e-08e64aa55e27 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:11.949024 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9bb3a2be-e6c8-4f26-981e-08e64aa55e27 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:11.949591 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9bb3a2be-e6c8-4f26-981e-08e64aa55e27 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:11.957731 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-3e207ca8-7abc-4601-abdd-980e02937aa0 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e" status: 200 len: 1522 microversion: 2.1 time: 0.266541 Aug 27 02:22:11.970173 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 108/212] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:22:11 2022] GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e => generated 1522 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:22:12.189234 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-9bb3a2be-e6c8-4f26-981e-08e64aa55e27 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc3be23405d4ae88dd46d656ad6a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc715590f88432d9b6e7dd779ad5851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:12.201785 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-9bb3a2be-e6c8-4f26-981e-08e64aa55e27 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] 10.222.0.61 "GET /compute/v2.1/servers/6dffef84-3605-422f-ac42-8c1614b24539" status: 200 len: 1501 microversion: 2.1 time: 0.268991 Aug 27 02:22:12.203926 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 105/213] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:22:11 2022] GET /compute/v2.1/servers/6dffef84-3605-422f-ac42-8c1614b24539 => generated 1501 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:22:12.436779 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [req-8eb170bd-1b4f-41c1-b1ea-014d2ede58ff req-8a358391-c70f-4dab-9d1f-6bba449a642a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "286c8683-8bd6-4dcc-8540-cc73dd752da5", "name": "network-vif-deleted", "tag": "c5ece479-76ab-48fe-baaa-f787a33a55f7"}]} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:22:12.452750 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-8eb170bd-1b4f-41c1-b1ea-014d2ede58ff req-8a358391-c70f-4dab-9d1f-6bba449a642a service nova] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:12.453859 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-8eb170bd-1b4f-41c1-b1ea-014d2ede58ff req-8a358391-c70f-4dab-9d1f-6bba449a642a service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:12.454681 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-8eb170bd-1b4f-41c1-b1ea-014d2ede58ff req-8a358391-c70f-4dab-9d1f-6bba449a642a service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:12.482563 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.compute.server_external_events [req-8eb170bd-1b4f-41c1-b1ea-014d2ede58ff req-8a358391-c70f-4dab-9d1f-6bba449a642a service nova] Creating event network-vif-deleted:c5ece479-76ab-48fe-baaa-f787a33a55f7 for instance 286c8683-8bd6-4dcc-8540-cc73dd752da5 on hv-cinder-84630 Aug 27 02:22:12.491112 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [req-8eb170bd-1b4f-41c1-b1ea-014d2ede58ff req-8a358391-c70f-4dab-9d1f-6bba449a642a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060177 Aug 27 02:22:12.492036 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 109/214] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Aug 27 02:22:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:22:12.495139 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [req-e77d65f1-6ff8-489b-b005-7803ba3e6442 req-8e402c8e-2dcc-449e-af34-04c7b537bef4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dffef84-3605-422f-ac42-8c1614b24539", "name": "network-vif-deleted", "tag": "8c960645-780e-4056-84f6-f734369fcc20"}]} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:22:12.510267 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-e77d65f1-6ff8-489b-b005-7803ba3e6442 req-8e402c8e-2dcc-449e-af34-04c7b537bef4 service nova] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:12.511616 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-e77d65f1-6ff8-489b-b005-7803ba3e6442 req-8e402c8e-2dcc-449e-af34-04c7b537bef4 service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:12.512537 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-e77d65f1-6ff8-489b-b005-7803ba3e6442 req-8e402c8e-2dcc-449e-af34-04c7b537bef4 service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:12.528292 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.compute.server_external_events [req-e77d65f1-6ff8-489b-b005-7803ba3e6442 req-8e402c8e-2dcc-449e-af34-04c7b537bef4 service nova] Creating event network-vif-deleted:8c960645-780e-4056-84f6-f734369fcc20 for instance 6dffef84-3605-422f-ac42-8c1614b24539 on hv-cinder-84630 Aug 27 02:22:12.535265 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [req-e77d65f1-6ff8-489b-b005-7803ba3e6442 req-8e402c8e-2dcc-449e-af34-04c7b537bef4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044791 Aug 27 02:22:12.540357 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 106/215] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Aug 27 02:22:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:22:12.732055 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-0eb382d8-7368-4394-ba4e-9cbedfdf9e39 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:12.733898 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-0eb382d8-7368-4394-ba4e-9cbedfdf9e39 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] [instance: 286c8683-8bd6-4dcc-8540-cc73dd752da5] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:12.745950 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0eb382d8-7368-4394-ba4e-9cbedfdf9e39 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:12.749438 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0eb382d8-7368-4394-ba4e-9cbedfdf9e39 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:12.749937 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0eb382d8-7368-4394-ba4e-9cbedfdf9e39 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:12.750686 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0eb382d8-7368-4394-ba4e-9cbedfdf9e39 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:12.751419 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0eb382d8-7368-4394-ba4e-9cbedfdf9e39 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:12.751988 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0eb382d8-7368-4394-ba4e-9cbedfdf9e39 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:12.790092 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0eb382d8-7368-4394-ba4e-9cbedfdf9e39 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:12.791021 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0eb382d8-7368-4394-ba4e-9cbedfdf9e39 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:12.791803 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0eb382d8-7368-4394-ba4e-9cbedfdf9e39 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:12.792245 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.objects.instance [None req-0eb382d8-7368-4394-ba4e-9cbedfdf9e39 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Lazy-loading 'fault' on Instance uuid 286c8683-8bd6-4dcc-8540-cc73dd752da5 {{(pid=120782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:22:12.865220 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-0eb382d8-7368-4394-ba4e-9cbedfdf9e39 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3800f9c3071b4c908b4d378c69953228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74107e05cf1644fc805625368fca2cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:12.881627 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-0eb382d8-7368-4394-ba4e-9cbedfdf9e39 tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] 10.222.0.61 "GET /compute/v2.1/servers/286c8683-8bd6-4dcc-8540-cc73dd752da5" status: 200 len: 1305 microversion: 2.1 time: 0.152589 Aug 27 02:22:12.889690 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 110/216] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:22:12 2022] GET /compute/v2.1/servers/286c8683-8bd6-4dcc-8540-cc73dd752da5 => generated 1305 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:22:12.983633 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-b279585d-daa4-4213-b26b-aaf64cd0ca7e tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:12.984382 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-b279585d-daa4-4213-b26b-aaf64cd0ca7e tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 5cbe7ad9-5124-4014-9d2a-e877493b2a9e] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:12.991293 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b279585d-daa4-4213-b26b-aaf64cd0ca7e tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:12.991811 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b279585d-daa4-4213-b26b-aaf64cd0ca7e tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:12.992226 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b279585d-daa4-4213-b26b-aaf64cd0ca7e tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:12.992943 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b279585d-daa4-4213-b26b-aaf64cd0ca7e tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:12.993482 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b279585d-daa4-4213-b26b-aaf64cd0ca7e tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:12.994040 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b279585d-daa4-4213-b26b-aaf64cd0ca7e tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:13.176148 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-b279585d-daa4-4213-b26b-aaf64cd0ca7e tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:13.184644 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-b279585d-daa4-4213-b26b-aaf64cd0ca7e tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e" status: 200 len: 1522 microversion: 2.1 time: 0.206114 Aug 27 02:22:13.185245 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 107/217] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:22:12 2022] GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:22:13.227881 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-ae9ffec3-ac26-4c4e-974e-442c6d150ad1 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:13.228564 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-ae9ffec3-ac26-4c4e-974e-442c6d150ad1 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] [instance: 6dffef84-3605-422f-ac42-8c1614b24539] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:13.235580 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ae9ffec3-ac26-4c4e-974e-442c6d150ad1 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:13.236068 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ae9ffec3-ac26-4c4e-974e-442c6d150ad1 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:13.236497 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ae9ffec3-ac26-4c4e-974e-442c6d150ad1 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:13.237221 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ae9ffec3-ac26-4c4e-974e-442c6d150ad1 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:13.237702 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ae9ffec3-ac26-4c4e-974e-442c6d150ad1 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:13.238115 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ae9ffec3-ac26-4c4e-974e-442c6d150ad1 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:13.275569 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ae9ffec3-ac26-4c4e-974e-442c6d150ad1 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:13.276046 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ae9ffec3-ac26-4c4e-974e-442c6d150ad1 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:13.276507 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ae9ffec3-ac26-4c4e-974e-442c6d150ad1 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:13.277059 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.objects.instance [None req-ae9ffec3-ac26-4c4e-974e-442c6d150ad1 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Lazy-loading 'fault' on Instance uuid 6dffef84-3605-422f-ac42-8c1614b24539 {{(pid=120782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:22:13.323587 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-ae9ffec3-ac26-4c4e-974e-442c6d150ad1 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc3be23405d4ae88dd46d656ad6a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc715590f88432d9b6e7dd779ad5851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:13.333078 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-ae9ffec3-ac26-4c4e-974e-442c6d150ad1 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] 10.222.0.61 "GET /compute/v2.1/servers/6dffef84-3605-422f-ac42-8c1614b24539" status: 200 len: 1302 microversion: 2.1 time: 0.108269 Aug 27 02:22:13.333078 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 111/218] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:22:13 2022] GET /compute/v2.1/servers/6dffef84-3605-422f-ac42-8c1614b24539 => generated 1302 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:22:13.910657 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-47e5970f-f06d-4926-8ce0-7d1ebbac804a tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:13.911042 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-47e5970f-f06d-4926-8ce0-7d1ebbac804a tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] [instance: 286c8683-8bd6-4dcc-8540-cc73dd752da5] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:13.917456 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-47e5970f-f06d-4926-8ce0-7d1ebbac804a tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:13.917945 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-47e5970f-f06d-4926-8ce0-7d1ebbac804a tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:13.918379 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-47e5970f-f06d-4926-8ce0-7d1ebbac804a tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:13.919174 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-47e5970f-f06d-4926-8ce0-7d1ebbac804a tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:13.919615 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-47e5970f-f06d-4926-8ce0-7d1ebbac804a tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:13.920050 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-47e5970f-f06d-4926-8ce0-7d1ebbac804a tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:14.078565 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.wsgi [None req-47e5970f-f06d-4926-8ce0-7d1ebbac804a tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] HTTP exception thrown: Instance 286c8683-8bd6-4dcc-8540-cc73dd752da5 could not be found. Aug 27 02:22:14.080221 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-47e5970f-f06d-4926-8ce0-7d1ebbac804a tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Request method failure captured: Aug 27 02:22:14.080221 dv-cinder-846303-3-smb devstack@n-api.service[120783]: request: GET /compute/v2.1/servers/286c8683-8bd6-4dcc-8540-cc73dd752da5 HTTP/1.1 Aug 27 02:22:14.080221 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Accept: application/json Aug 27 02:22:14.080221 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Accept-Encoding: identity Aug 27 02:22:14.080221 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Connection: close Aug 27 02:22:14.080221 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Content-Length: 0 Aug 27 02:22:14.080221 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Content-Type: application/json Aug 27 02:22:14.080221 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Host: 10.222.0.61 Aug 27 02:22:14.080221 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Openstack-System-Scope: None Aug 27 02:22:14.080221 dv-cinder-846303-3-smb devstack@n-api.service[120783]: User-Agent: python-urllib3/1.26.11 Aug 27 02:22:14.080221 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Auth-Token: gAAAAABjCX-6hUeQqkVLqUjPqA_KfUmEwffgh1CLEZrhKwz6DFrbqSCw0axZUDDR54U4hbAwj3L4AbgvdrFVHqay0TO4FBG15RdwhehcDndYxfYWRciaGyGBZNwsaa8zl0fMXmZKN0RDRBltNHNzmap2mrUcyz8yoOkzXZ0qJaex6aGkRNH6FBk Aug 27 02:22:14.080221 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Domain-Id: None Aug 27 02:22:14.080221 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Domain-Name: None Aug 27 02:22:14.080221 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Identity-Status: Confirmed Aug 27 02:22:14.080221 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Is-Admin-Project: True Aug 27 02:22:14.080221 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Project-Domain-Id: default Aug 27 02:22:14.080221 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Project-Domain-Name: Default Aug 27 02:22:14.080221 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Project-Id: 74107e05cf1644fc805625368fca2cbb Aug 27 02:22:14.080221 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Project-Name: tempest-VolumesNegativeTest-182683700 Aug 27 02:22:14.080221 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Role: member,reader Aug 27 02:22:14.080221 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Roles: member,reader Aug 27 02:22:14.082556 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/74107e05cf1644fc805625368fca2cbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_74107e05cf1644fc805625368fca2cbb", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/74107e05cf1644fc805625368fca2cbb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/74107e05cf1644fc805625368fca2cbb"}]}] Aug 27 02:22:14.082556 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Tenant: tempest-VolumesNegativeTest-182683700 Aug 27 02:22:14.082556 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Tenant-Id: 74107e05cf1644fc805625368fca2cbb Aug 27 02:22:14.082556 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Tenant-Name: tempest-VolumesNegativeTest-182683700 Aug 27 02:22:14.082556 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User: tempest-VolumesNegativeTest-182683700-project Aug 27 02:22:14.082556 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User-Domain-Id: default Aug 27 02:22:14.082556 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User-Domain-Name: Default Aug 27 02:22:14.082556 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User-Id: 3800f9c3071b4c908b4d378c69953228 Aug 27 02:22:14.082556 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User-Name: tempest-VolumesNegativeTest-182683700-project Aug 27 02:22:14.082556 dv-cinder-846303-3-smb devstack@n-api.service[120783]: method: > Aug 27 02:22:14.082556 dv-cinder-846303-3-smb devstack@n-api.service[120783]: exception: Instance 286c8683-8bd6-4dcc-8540-cc73dd752da5 could not be found. Aug 27 02:22:14.082556 dv-cinder-846303-3-smb devstack@n-api.service[120783]: action_args: {'id': '286c8683-8bd6-4dcc-8540-cc73dd752da5'} Aug 27 02:22:14.083895 dv-cinder-846303-3-smb devstack@n-api.service[120783]: {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:22:14.083895 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:22:14.083895 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:22:14.083895 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:22:14.083895 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:22:14.083895 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:22:14.083895 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:22:14.083895 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:22:14.083895 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:22:14.083895 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:22:14.083895 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 286c8683-8bd6-4dcc-8540-cc73dd752da5 could not be found. Aug 27 02:22:14.083895 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:22:14.083895 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:22:14.083895 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:22:14.083895 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:22:14.083895 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:22:14.083895 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:22:14.083895 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:22:14.083895 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:22:14.083895 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:22:14.086599 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:22:14.086599 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:22:14.086599 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:22:14.086599 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:22:14.086599 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:22:14.086599 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:22:14.086599 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:22:14.086599 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 286c8683-8bd6-4dcc-8540-cc73dd752da5 could not be found. Aug 27 02:22:14.086599 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:22:14.086599 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:22:14.086599 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:22:14.086599 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:22:14.086599 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:22:14.086599 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:22:14.086599 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:22:14.086599 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:22:14.086599 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 286c8683-8bd6-4dcc-8540-cc73dd752da5 could not be found. Aug 27 02:22:14.086599 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:22:14.088822 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-47e5970f-f06d-4926-8ce0-7d1ebbac804a tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] Returning 404 to user: Instance 286c8683-8bd6-4dcc-8540-cc73dd752da5 could not be found. {{(pid=120783) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:22:14.088822 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-47e5970f-f06d-4926-8ce0-7d1ebbac804a tempest-VolumesNegativeTest-182683700 tempest-VolumesNegativeTest-182683700-project] 10.222.0.61 "GET /compute/v2.1/servers/286c8683-8bd6-4dcc-8540-cc73dd752da5" status: 404 len: 111 microversion: 2.1 time: 0.175462 Aug 27 02:22:14.088822 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 108/219] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:22:13 2022] GET /compute/v2.1/servers/286c8683-8bd6-4dcc-8540-cc73dd752da5 => generated 111 bytes in 177 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:22:14.210072 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-f1c2f883-f6d6-4923-a624-564ceac42e87 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:14.211334 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-f1c2f883-f6d6-4923-a624-564ceac42e87 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 5cbe7ad9-5124-4014-9d2a-e877493b2a9e] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:14.223912 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f1c2f883-f6d6-4923-a624-564ceac42e87 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:14.224483 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f1c2f883-f6d6-4923-a624-564ceac42e87 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:14.224894 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f1c2f883-f6d6-4923-a624-564ceac42e87 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:14.225634 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f1c2f883-f6d6-4923-a624-564ceac42e87 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:14.226272 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f1c2f883-f6d6-4923-a624-564ceac42e87 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:14.226696 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f1c2f883-f6d6-4923-a624-564ceac42e87 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:14.376843 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-fb2de12c-b9d8-4502-9dfc-61c31b08e0f1 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:14.377491 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-fb2de12c-b9d8-4502-9dfc-61c31b08e0f1 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] [instance: 6dffef84-3605-422f-ac42-8c1614b24539] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:14.390464 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fb2de12c-b9d8-4502-9dfc-61c31b08e0f1 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:14.390953 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fb2de12c-b9d8-4502-9dfc-61c31b08e0f1 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:14.391373 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fb2de12c-b9d8-4502-9dfc-61c31b08e0f1 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:14.398125 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fb2de12c-b9d8-4502-9dfc-61c31b08e0f1 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:14.400902 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fb2de12c-b9d8-4502-9dfc-61c31b08e0f1 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:14.401341 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fb2de12c-b9d8-4502-9dfc-61c31b08e0f1 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:14.434140 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.wsgi [None req-fb2de12c-b9d8-4502-9dfc-61c31b08e0f1 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] HTTP exception thrown: Instance 6dffef84-3605-422f-ac42-8c1614b24539 could not be found. Aug 27 02:22:14.436422 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-fb2de12c-b9d8-4502-9dfc-61c31b08e0f1 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Request method failure captured: Aug 27 02:22:14.436422 dv-cinder-846303-3-smb devstack@n-api.service[120783]: request: GET /compute/v2.1/servers/6dffef84-3605-422f-ac42-8c1614b24539 HTTP/1.1 Aug 27 02:22:14.436422 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Accept: application/json Aug 27 02:22:14.436422 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Accept-Encoding: identity Aug 27 02:22:14.436422 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Connection: close Aug 27 02:22:14.436422 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Content-Length: 0 Aug 27 02:22:14.436422 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Content-Type: application/json Aug 27 02:22:14.436422 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Host: 10.222.0.61 Aug 27 02:22:14.436422 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Openstack-System-Scope: None Aug 27 02:22:14.436422 dv-cinder-846303-3-smb devstack@n-api.service[120783]: User-Agent: python-urllib3/1.26.11 Aug 27 02:22:14.436422 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Auth-Token: gAAAAABjCX-2PdEJf8T8Et6uvgzxUJxdKfMlljJgvFRr03sNCSo5ig3YkNa_gWPPQgzdHC2qM_CJw_3FCQqe7upY-Uz4GhtnwdcUtkh4UoKvgRYya8cj4F_ZHRCFu2r8aZtd8U4ti0N2jOSDDPZH6iS5T4yACWGIJufOx6ilWGiAzLZbUKcgfZ8 Aug 27 02:22:14.436422 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Domain-Id: None Aug 27 02:22:14.436422 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Domain-Name: None Aug 27 02:22:14.436422 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Identity-Status: Confirmed Aug 27 02:22:14.436422 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Is-Admin-Project: True Aug 27 02:22:14.436422 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Project-Domain-Id: default Aug 27 02:22:14.436422 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Project-Domain-Name: Default Aug 27 02:22:14.436422 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Project-Id: bcc715590f88432d9b6e7dd779ad5851 Aug 27 02:22:14.436422 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Project-Name: tempest-VolumesActionsTest-145448802 Aug 27 02:22:14.436422 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Role: member,reader Aug 27 02:22:14.436422 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Roles: member,reader Aug 27 02:22:14.438718 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/bcc715590f88432d9b6e7dd779ad5851"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_bcc715590f88432d9b6e7dd779ad5851", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/bcc715590f88432d9b6e7dd779ad5851"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/bcc715590f88432d9b6e7dd779ad5851"}]}] Aug 27 02:22:14.438718 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Tenant: tempest-VolumesActionsTest-145448802 Aug 27 02:22:14.438718 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Tenant-Id: bcc715590f88432d9b6e7dd779ad5851 Aug 27 02:22:14.438718 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Tenant-Name: tempest-VolumesActionsTest-145448802 Aug 27 02:22:14.438718 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User: tempest-VolumesActionsTest-145448802-project Aug 27 02:22:14.438718 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User-Domain-Id: default Aug 27 02:22:14.438718 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User-Domain-Name: Default Aug 27 02:22:14.438718 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User-Id: 1bc3be23405d4ae88dd46d656ad6a3c8 Aug 27 02:22:14.438718 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User-Name: tempest-VolumesActionsTest-145448802-project Aug 27 02:22:14.438718 dv-cinder-846303-3-smb devstack@n-api.service[120783]: method: > Aug 27 02:22:14.438718 dv-cinder-846303-3-smb devstack@n-api.service[120783]: exception: Instance 6dffef84-3605-422f-ac42-8c1614b24539 could not be found. Aug 27 02:22:14.438718 dv-cinder-846303-3-smb devstack@n-api.service[120783]: action_args: {'id': '6dffef84-3605-422f-ac42-8c1614b24539'} Aug 27 02:22:14.440157 dv-cinder-846303-3-smb devstack@n-api.service[120783]: {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:22:14.440157 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:22:14.440157 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:22:14.440157 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:22:14.440157 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:22:14.440157 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:22:14.440157 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:22:14.440157 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:22:14.440157 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:22:14.440157 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:22:14.440157 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6dffef84-3605-422f-ac42-8c1614b24539 could not be found. Aug 27 02:22:14.440157 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:22:14.440157 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:22:14.440157 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:22:14.440157 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:22:14.440157 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:22:14.440157 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:22:14.440157 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:22:14.440157 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:22:14.440157 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:22:14.443637 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:22:14.443637 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:22:14.443637 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:22:14.443637 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:22:14.443637 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:22:14.443637 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:22:14.443637 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:22:14.443637 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6dffef84-3605-422f-ac42-8c1614b24539 could not be found. Aug 27 02:22:14.443637 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:22:14.443637 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:22:14.443637 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:22:14.443637 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:22:14.443637 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:22:14.443637 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:22:14.443637 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:22:14.443637 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:22:14.443637 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6dffef84-3605-422f-ac42-8c1614b24539 could not be found. Aug 27 02:22:14.443637 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:22:14.446723 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-fb2de12c-b9d8-4502-9dfc-61c31b08e0f1 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] Returning 404 to user: Instance 6dffef84-3605-422f-ac42-8c1614b24539 could not be found. {{(pid=120783) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:22:14.449502 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-fb2de12c-b9d8-4502-9dfc-61c31b08e0f1 tempest-VolumesActionsTest-145448802 tempest-VolumesActionsTest-145448802-project] 10.222.0.61 "GET /compute/v2.1/servers/6dffef84-3605-422f-ac42-8c1614b24539" status: 404 len: 111 microversion: 2.1 time: 0.084215 Aug 27 02:22:14.451166 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 109/220] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:22:14 2022] GET /compute/v2.1/servers/6dffef84-3605-422f-ac42-8c1614b24539 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:22:14.457322 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-f1c2f883-f6d6-4923-a624-564ceac42e87 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:14.467235 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-f1c2f883-f6d6-4923-a624-564ceac42e87 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e" status: 200 len: 1522 microversion: 2.1 time: 0.264405 Aug 27 02:22:14.467825 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 112/221] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:22:14 2022] GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e => generated 1522 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:22:15.496497 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-e94705da-6395-4ebd-9d6e-ccf67743c98f tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:15.497868 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-e94705da-6395-4ebd-9d6e-ccf67743c98f tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 5cbe7ad9-5124-4014-9d2a-e877493b2a9e] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:15.505653 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:22:15.507603 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e94705da-6395-4ebd-9d6e-ccf67743c98f tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:15.508785 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e94705da-6395-4ebd-9d6e-ccf67743c98f tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:15.509568 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e94705da-6395-4ebd-9d6e-ccf67743c98f tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:15.510560 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e94705da-6395-4ebd-9d6e-ccf67743c98f tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:15.511260 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e94705da-6395-4ebd-9d6e-ccf67743c98f tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:15.514583 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e94705da-6395-4ebd-9d6e-ccf67743c98f tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:15.733929 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-e94705da-6395-4ebd-9d6e-ccf67743c98f tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:15.751627 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-e94705da-6395-4ebd-9d6e-ccf67743c98f tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e" status: 200 len: 1522 microversion: 2.1 time: 0.265484 Aug 27 02:22:15.752284 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 110/222] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:22:15 2022] GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e => generated 1522 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:22:16.774956 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-ddbd22a9-8fa9-4400-a4c3-be094f4c8bbc tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:16.775786 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-ddbd22a9-8fa9-4400-a4c3-be094f4c8bbc tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 5cbe7ad9-5124-4014-9d2a-e877493b2a9e] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:16.783081 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ddbd22a9-8fa9-4400-a4c3-be094f4c8bbc tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:16.784435 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ddbd22a9-8fa9-4400-a4c3-be094f4c8bbc tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:16.784950 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ddbd22a9-8fa9-4400-a4c3-be094f4c8bbc tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:16.786441 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ddbd22a9-8fa9-4400-a4c3-be094f4c8bbc tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:16.787434 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ddbd22a9-8fa9-4400-a4c3-be094f4c8bbc tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:16.788252 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ddbd22a9-8fa9-4400-a4c3-be094f4c8bbc tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:17.048478 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-ddbd22a9-8fa9-4400-a4c3-be094f4c8bbc tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:17.072532 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-ddbd22a9-8fa9-4400-a4c3-be094f4c8bbc tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e" status: 200 len: 1522 microversion: 2.1 time: 0.302480 Aug 27 02:22:17.080747 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 113/223] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:22:16 2022] GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e => generated 1522 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:22:18.096469 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-dbcaddca-e948-49d0-ac25-c077f5e14b96 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:18.097167 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-dbcaddca-e948-49d0-ac25-c077f5e14b96 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 5cbe7ad9-5124-4014-9d2a-e877493b2a9e] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:18.112751 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-dbcaddca-e948-49d0-ac25-c077f5e14b96 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:18.113228 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-dbcaddca-e948-49d0-ac25-c077f5e14b96 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:18.113709 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-dbcaddca-e948-49d0-ac25-c077f5e14b96 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:18.114447 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-dbcaddca-e948-49d0-ac25-c077f5e14b96 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:18.115008 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-dbcaddca-e948-49d0-ac25-c077f5e14b96 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:18.115495 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-dbcaddca-e948-49d0-ac25-c077f5e14b96 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:18.287222 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-dbcaddca-e948-49d0-ac25-c077f5e14b96 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:18.297552 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-dbcaddca-e948-49d0-ac25-c077f5e14b96 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e" status: 200 len: 1522 microversion: 2.1 time: 0.205270 Aug 27 02:22:18.298693 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 111/224] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:22:18 2022] GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e => generated 1522 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:22:19.323602 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-78b505b3-4479-4ade-8d63-df09f65e1576 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:19.324268 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-78b505b3-4479-4ade-8d63-df09f65e1576 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 5cbe7ad9-5124-4014-9d2a-e877493b2a9e] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:19.330690 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-78b505b3-4479-4ade-8d63-df09f65e1576 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:19.331422 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-78b505b3-4479-4ade-8d63-df09f65e1576 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:19.332061 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-78b505b3-4479-4ade-8d63-df09f65e1576 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:19.332815 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-78b505b3-4479-4ade-8d63-df09f65e1576 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:19.333280 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-78b505b3-4479-4ade-8d63-df09f65e1576 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:19.333726 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-78b505b3-4479-4ade-8d63-df09f65e1576 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:19.496089 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-78b505b3-4479-4ade-8d63-df09f65e1576 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:19.507445 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-78b505b3-4479-4ade-8d63-df09f65e1576 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e" status: 200 len: 1522 microversion: 2.1 time: 0.187534 Aug 27 02:22:19.507941 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 114/225] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:22:19 2022] GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:22:20.541780 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-4955f2b7-b776-4ee7-b64a-cb5cb52bc498 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:20.543521 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-4955f2b7-b776-4ee7-b64a-cb5cb52bc498 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 5cbe7ad9-5124-4014-9d2a-e877493b2a9e] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:20.553218 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4955f2b7-b776-4ee7-b64a-cb5cb52bc498 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:20.554746 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4955f2b7-b776-4ee7-b64a-cb5cb52bc498 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:20.555679 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4955f2b7-b776-4ee7-b64a-cb5cb52bc498 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:20.557261 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4955f2b7-b776-4ee7-b64a-cb5cb52bc498 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:20.558441 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4955f2b7-b776-4ee7-b64a-cb5cb52bc498 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:20.559349 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4955f2b7-b776-4ee7-b64a-cb5cb52bc498 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:20.846794 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-4955f2b7-b776-4ee7-b64a-cb5cb52bc498 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:20.878026 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-4955f2b7-b776-4ee7-b64a-cb5cb52bc498 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e" status: 200 len: 1502 microversion: 2.1 time: 0.342206 Aug 27 02:22:20.879105 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 112/226] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:22:20 2022] GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e => generated 1502 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:22:20.914344 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-fdbc1527-9226-4b8d-a4de-2f8dd5598d22 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:20.915924 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-fdbc1527-9226-4b8d-a4de-2f8dd5598d22 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 7122531d-d371-4c4c-8d9f-fc74be8649c1] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:20.922765 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fdbc1527-9226-4b8d-a4de-2f8dd5598d22 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:20.923584 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fdbc1527-9226-4b8d-a4de-2f8dd5598d22 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:20.924024 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fdbc1527-9226-4b8d-a4de-2f8dd5598d22 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:20.924744 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fdbc1527-9226-4b8d-a4de-2f8dd5598d22 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:20.925199 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fdbc1527-9226-4b8d-a4de-2f8dd5598d22 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:20.925656 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fdbc1527-9226-4b8d-a4de-2f8dd5598d22 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:21.154872 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-fdbc1527-9226-4b8d-a4de-2f8dd5598d22 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:21.165591 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-fdbc1527-9226-4b8d-a4de-2f8dd5598d22 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/7122531d-d371-4c4c-8d9f-fc74be8649c1" status: 200 len: 1516 microversion: 2.1 time: 0.261161 Aug 27 02:22:21.166510 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 115/227] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:22:20 2022] GET /compute/v2.1/servers/7122531d-d371-4c4c-8d9f-fc74be8649c1 => generated 1516 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:22:22.767323 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-d4b9ebd8-bc33-4b98-b9c8-e84ba7c611a4 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:22:22.772130 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-d4b9ebd8-bc33-4b98-b9c8-e84ba7c611a4 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 7122531d-d371-4c4c-8d9f-fc74be8649c1] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:22.780098 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d4b9ebd8-bc33-4b98-b9c8-e84ba7c611a4 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:22.780886 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d4b9ebd8-bc33-4b98-b9c8-e84ba7c611a4 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:22.781531 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d4b9ebd8-bc33-4b98-b9c8-e84ba7c611a4 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:22.782406 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d4b9ebd8-bc33-4b98-b9c8-e84ba7c611a4 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:22.783007 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d4b9ebd8-bc33-4b98-b9c8-e84ba7c611a4 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:22.783591 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d4b9ebd8-bc33-4b98-b9c8-e84ba7c611a4 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:22.811548 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.objects.instance [None req-d4b9ebd8-bc33-4b98-b9c8-e84ba7c611a4 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lazy-loading 'flavor' on Instance uuid 7122531d-d371-4c4c-8d9f-fc74be8649c1 {{(pid=120783) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:22:22.914054 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-d4b9ebd8-bc33-4b98-b9c8-e84ba7c611a4 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "POST /compute/v2.1/servers/7122531d-d371-4c4c-8d9f-fc74be8649c1/action" status: 200 len: 32 microversion: 2.1 time: 0.152026 Aug 27 02:22:22.915132 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 113/228] 10.222.0.61 () {60 vars in 1278 bytes} [Sat Aug 27 02:22:22 2022] POST /compute/v2.1/servers/7122531d-d371-4c4c-8d9f-fc74be8649c1/action => generated 32 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:22:22.940224 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-fc40829a-02cd-42e5-909f-37c85b2754d6 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:22.945098 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-fc40829a-02cd-42e5-909f-37c85b2754d6 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 7122531d-d371-4c4c-8d9f-fc74be8649c1] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:22.969519 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fc40829a-02cd-42e5-909f-37c85b2754d6 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:22.970712 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fc40829a-02cd-42e5-909f-37c85b2754d6 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:22.972561 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fc40829a-02cd-42e5-909f-37c85b2754d6 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:22.974705 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fc40829a-02cd-42e5-909f-37c85b2754d6 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:22.975706 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fc40829a-02cd-42e5-909f-37c85b2754d6 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:22.976706 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fc40829a-02cd-42e5-909f-37c85b2754d6 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:23.361369 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-fc40829a-02cd-42e5-909f-37c85b2754d6 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:23.376404 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-fc40829a-02cd-42e5-909f-37c85b2754d6 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/7122531d-d371-4c4c-8d9f-fc74be8649c1" status: 200 len: 1522 microversion: 2.1 time: 0.451870 Aug 27 02:22:23.377838 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 116/229] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:22:22 2022] GET /compute/v2.1/servers/7122531d-d371-4c4c-8d9f-fc74be8649c1 => generated 1522 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:22:24.411178 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-d4c0c6e7-211b-455a-8e37-c199e6fa8d8d tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:24.412496 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-d4c0c6e7-211b-455a-8e37-c199e6fa8d8d tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 7122531d-d371-4c4c-8d9f-fc74be8649c1] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:24.420075 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d4c0c6e7-211b-455a-8e37-c199e6fa8d8d tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:24.420541 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d4c0c6e7-211b-455a-8e37-c199e6fa8d8d tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:24.421417 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d4c0c6e7-211b-455a-8e37-c199e6fa8d8d tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:24.421698 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d4c0c6e7-211b-455a-8e37-c199e6fa8d8d tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:24.422149 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d4c0c6e7-211b-455a-8e37-c199e6fa8d8d tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:24.422562 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d4c0c6e7-211b-455a-8e37-c199e6fa8d8d tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:24.446547 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:22:24.576909 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-d4c0c6e7-211b-455a-8e37-c199e6fa8d8d tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:24.586002 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-d4c0c6e7-211b-455a-8e37-c199e6fa8d8d tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/7122531d-d371-4c4c-8d9f-fc74be8649c1" status: 200 len: 1522 microversion: 2.1 time: 0.179199 Aug 27 02:22:24.586589 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 114/230] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:22:24 2022] GET /compute/v2.1/servers/7122531d-d371-4c4c-8d9f-fc74be8649c1 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:22:25.413993 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-c9d5f037-5a09-4840-8f88-30e0a701567d tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1597600525", "imageRef": "7d45cdd6-750f-40c7-9475-f7bf12fcb204", "flavorRef": "452", "networks": [{"uuid": "a8404694-5630-4006-bcb7-562e0f1845bc"}]}} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:22:25.471791 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.network.neutron [None req-c9d5f037-5a09-4840-8f88-30e0a701567d tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] validate_networks() for [('a8404694-5630-4006-bcb7-562e0f1845bc', None, None, None, None, None)] {{(pid=120782) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:22:25.607195 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-59a260af-4689-477d-aa8d-5edbb73705e0 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:25.607844 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-59a260af-4689-477d-aa8d-5edbb73705e0 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 7122531d-d371-4c4c-8d9f-fc74be8649c1] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:25.615443 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-59a260af-4689-477d-aa8d-5edbb73705e0 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:25.615941 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-59a260af-4689-477d-aa8d-5edbb73705e0 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:25.616380 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-59a260af-4689-477d-aa8d-5edbb73705e0 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:25.617185 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-59a260af-4689-477d-aa8d-5edbb73705e0 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:25.617644 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-59a260af-4689-477d-aa8d-5edbb73705e0 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:25.618373 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-59a260af-4689-477d-aa8d-5edbb73705e0 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:25.769596 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-59a260af-4689-477d-aa8d-5edbb73705e0 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:25.777658 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-59a260af-4689-477d-aa8d-5edbb73705e0 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/7122531d-d371-4c4c-8d9f-fc74be8649c1" status: 200 len: 1522 microversion: 2.1 time: 0.174594 Aug 27 02:22:25.778238 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 115/231] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:22:25 2022] GET /compute/v2.1/servers/7122531d-d371-4c4c-8d9f-fc74be8649c1 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:22:25.877055 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-c9d5f037-5a09-4840-8f88-30e0a701567d tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Flavor limits 0:0:0 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:22:25.877524 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-c9d5f037-5a09-4840-8f88-30e0a701567d tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Image limits 0:0:0 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:22:25.878163 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-c9d5f037-5a09-4840-8f88-30e0a701567d tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Flavor pref 0:0:0 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:22:25.878573 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-c9d5f037-5a09-4840-8f88-30e0a701567d tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Image pref 0:0:0 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:22:25.879046 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-c9d5f037-5a09-4840-8f88-30e0a701567d tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:22:25.888598 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c9d5f037-5a09-4840-8f88-30e0a701567d tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:25.889073 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c9d5f037-5a09-4840-8f88-30e0a701567d tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:25.889556 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c9d5f037-5a09-4840-8f88-30e0a701567d tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:25.890283 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c9d5f037-5a09-4840-8f88-30e0a701567d tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:25.890733 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c9d5f037-5a09-4840-8f88-30e0a701567d tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:25.891152 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c9d5f037-5a09-4840-8f88-30e0a701567d tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:25.909031 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.quota [None req-c9d5f037-5a09-4840-8f88-30e0a701567d tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Getting quotas for project ac7bf59244bc487b84c7dbf9aa7314d2. Resources: {'instances', 'ram', 'cores'} {{(pid=120782) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:22:25.913315 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.quota [None req-c9d5f037-5a09-4840-8f88-30e0a701567d tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Getting quotas for user 2f931e726872474dae2b7b6fbb0eb644 and project ac7bf59244bc487b84c7dbf9aa7314d2. Resources: {'instances', 'ram', 'cores'} {{(pid=120782) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:22:25.925074 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-c9d5f037-5a09-4840-8f88-30e0a701567d tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Going to run 1 instances... {{(pid=120782) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:22:25.927562 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-c9d5f037-5a09-4840-8f88-30e0a701567d tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] [instance: 35d91cb7-f14b-4788-b503-ea9feaee650b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7d45cdd6-750f-40c7-9475-f7bf12fcb204',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120782) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:22:25.978554 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-c9d5f037-5a09-4840-8f88-30e0a701567d tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.569018 Aug 27 02:22:25.985446 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 117/232] 10.222.0.61 () {60 vars in 1147 bytes} [Sat Aug 27 02:22:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 571 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:22:25.992845 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-1ceeee42-034f-491e-82a0-b8bb1e215770 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:25.993480 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-1ceeee42-034f-491e-82a0-b8bb1e215770 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] [instance: 35d91cb7-f14b-4788-b503-ea9feaee650b] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:26.073995 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-1ceeee42-034f-491e-82a0-b8bb1e215770 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f931e726872474dae2b7b6fbb0eb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7bf59244bc487b84c7dbf9aa7314d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:26.082664 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-1ceeee42-034f-491e-82a0-b8bb1e215770 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] 10.222.0.61 "GET /compute/v2.1/servers/35d91cb7-f14b-4788-b503-ea9feaee650b" status: 200 len: 1219 microversion: 2.1 time: 0.093841 Aug 27 02:22:26.083527 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 116/233] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:22:25 2022] GET /compute/v2.1/servers/35d91cb7-f14b-4788-b503-ea9feaee650b => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:22:26.801709 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-bd31518d-fda3-4995-bda2-1235ed89d61e tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:26.803036 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-bd31518d-fda3-4995-bda2-1235ed89d61e tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 7122531d-d371-4c4c-8d9f-fc74be8649c1] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:26.813734 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-bd31518d-fda3-4995-bda2-1235ed89d61e tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:26.814985 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-bd31518d-fda3-4995-bda2-1235ed89d61e tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:26.815782 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-bd31518d-fda3-4995-bda2-1235ed89d61e tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:26.817044 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-bd31518d-fda3-4995-bda2-1235ed89d61e tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:26.818305 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-bd31518d-fda3-4995-bda2-1235ed89d61e tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:26.819404 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-bd31518d-fda3-4995-bda2-1235ed89d61e tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:26.984513 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-bd31518d-fda3-4995-bda2-1235ed89d61e tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:26.992443 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-bd31518d-fda3-4995-bda2-1235ed89d61e tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/7122531d-d371-4c4c-8d9f-fc74be8649c1" status: 200 len: 1522 microversion: 2.1 time: 0.197408 Aug 27 02:22:26.993020 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 118/234] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:22:26 2022] GET /compute/v2.1/servers/7122531d-d371-4c4c-8d9f-fc74be8649c1 => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:22:27.104351 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-aecd6dcb-0b7c-46c1-a21a-dbc791c00832 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:27.104964 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-aecd6dcb-0b7c-46c1-a21a-dbc791c00832 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] [instance: 35d91cb7-f14b-4788-b503-ea9feaee650b] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:27.112426 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-aecd6dcb-0b7c-46c1-a21a-dbc791c00832 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:27.112917 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-aecd6dcb-0b7c-46c1-a21a-dbc791c00832 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:27.113338 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-aecd6dcb-0b7c-46c1-a21a-dbc791c00832 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:27.114070 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-aecd6dcb-0b7c-46c1-a21a-dbc791c00832 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:27.114512 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-aecd6dcb-0b7c-46c1-a21a-dbc791c00832 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:27.114928 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-aecd6dcb-0b7c-46c1-a21a-dbc791c00832 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:27.175881 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-aecd6dcb-0b7c-46c1-a21a-dbc791c00832 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f931e726872474dae2b7b6fbb0eb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7bf59244bc487b84c7dbf9aa7314d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:27.184345 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-aecd6dcb-0b7c-46c1-a21a-dbc791c00832 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] 10.222.0.61 "GET /compute/v2.1/servers/35d91cb7-f14b-4788-b503-ea9feaee650b" status: 200 len: 1271 microversion: 2.1 time: 0.083888 Aug 27 02:22:27.184935 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 117/235] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:22:27 2022] GET /compute/v2.1/servers/35d91cb7-f14b-4788-b503-ea9feaee650b => generated 1271 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:22:28.013598 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-fbc39b42-9acc-471b-ada2-b5e50af1522d tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:28.014367 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-fbc39b42-9acc-471b-ada2-b5e50af1522d tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 7122531d-d371-4c4c-8d9f-fc74be8649c1] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:28.021666 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fbc39b42-9acc-471b-ada2-b5e50af1522d tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:28.022243 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fbc39b42-9acc-471b-ada2-b5e50af1522d tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:28.022767 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fbc39b42-9acc-471b-ada2-b5e50af1522d tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:28.023540 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fbc39b42-9acc-471b-ada2-b5e50af1522d tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:28.024320 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fbc39b42-9acc-471b-ada2-b5e50af1522d tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:28.024782 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fbc39b42-9acc-471b-ada2-b5e50af1522d tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:28.193892 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-fbc39b42-9acc-471b-ada2-b5e50af1522d tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:28.205778 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-97155e12-2e68-4859-bdc9-0d4739f2c662 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:28.206329 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-fbc39b42-9acc-471b-ada2-b5e50af1522d tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/7122531d-d371-4c4c-8d9f-fc74be8649c1" status: 200 len: 1522 microversion: 2.1 time: 0.196332 Aug 27 02:22:28.207404 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-97155e12-2e68-4859-bdc9-0d4739f2c662 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] [instance: 35d91cb7-f14b-4788-b503-ea9feaee650b] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:28.214793 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-97155e12-2e68-4859-bdc9-0d4739f2c662 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:28.215674 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-97155e12-2e68-4859-bdc9-0d4739f2c662 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:28.216326 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-97155e12-2e68-4859-bdc9-0d4739f2c662 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:28.217243 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-97155e12-2e68-4859-bdc9-0d4739f2c662 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:28.217898 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-97155e12-2e68-4859-bdc9-0d4739f2c662 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:28.218526 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-97155e12-2e68-4859-bdc9-0d4739f2c662 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:28.220318 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 119/236] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:22:28 2022] GET /compute/v2.1/servers/7122531d-d371-4c4c-8d9f-fc74be8649c1 => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:22:28.296309 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-97155e12-2e68-4859-bdc9-0d4739f2c662 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f931e726872474dae2b7b6fbb0eb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7bf59244bc487b84c7dbf9aa7314d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:28.304859 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-97155e12-2e68-4859-bdc9-0d4739f2c662 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] 10.222.0.61 "GET /compute/v2.1/servers/35d91cb7-f14b-4788-b503-ea9feaee650b" status: 200 len: 1277 microversion: 2.1 time: 0.102923 Aug 27 02:22:28.305681 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 118/237] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:22:28 2022] GET /compute/v2.1/servers/35d91cb7-f14b-4788-b503-ea9feaee650b => generated 1277 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:22:29.212788 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [req-af1b5ab8-a6eb-41c0-9d06-3b0c4be56c24 req-91e6a38b-d23c-4d26-96cd-6a6c878e167c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35d91cb7-f14b-4788-b503-ea9feaee650b", "tag": "09c1cd32-b4a2-4973-8cda-7a230514db53"}]} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:22:29.228040 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-af1b5ab8-a6eb-41c0-9d06-3b0c4be56c24 req-91e6a38b-d23c-4d26-96cd-6a6c878e167c service nova] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:29.228611 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-af1b5ab8-a6eb-41c0-9d06-3b0c4be56c24 req-91e6a38b-d23c-4d26-96cd-6a6c878e167c service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:29.229476 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-af1b5ab8-a6eb-41c0-9d06-3b0c4be56c24 req-91e6a38b-d23c-4d26-96cd-6a6c878e167c service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:29.231744 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-3217b799-831b-4595-8cef-8f4a1ea12233 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:29.232947 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-3217b799-831b-4595-8cef-8f4a1ea12233 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 7122531d-d371-4c4c-8d9f-fc74be8649c1] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:29.240954 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3217b799-831b-4595-8cef-8f4a1ea12233 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:29.242354 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3217b799-831b-4595-8cef-8f4a1ea12233 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:29.243073 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3217b799-831b-4595-8cef-8f4a1ea12233 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:29.243999 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3217b799-831b-4595-8cef-8f4a1ea12233 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:29.244642 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3217b799-831b-4595-8cef-8f4a1ea12233 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:29.245225 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3217b799-831b-4595-8cef-8f4a1ea12233 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:29.246918 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.compute.server_external_events [req-af1b5ab8-a6eb-41c0-9d06-3b0c4be56c24 req-91e6a38b-d23c-4d26-96cd-6a6c878e167c service nova] Creating event network-changed:09c1cd32-b4a2-4973-8cda-7a230514db53 for instance 35d91cb7-f14b-4788-b503-ea9feaee650b on hv-cinder-84630 Aug 27 02:22:29.256677 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [req-af1b5ab8-a6eb-41c0-9d06-3b0c4be56c24 req-91e6a38b-d23c-4d26-96cd-6a6c878e167c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048205 Aug 27 02:22:29.258111 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 120/238] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Aug 27 02:22:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:22:29.328169 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-805adaad-24ce-441d-8ba0-fddbac177069 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:29.328842 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-805adaad-24ce-441d-8ba0-fddbac177069 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] [instance: 35d91cb7-f14b-4788-b503-ea9feaee650b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:29.338121 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-805adaad-24ce-441d-8ba0-fddbac177069 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:29.338612 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-805adaad-24ce-441d-8ba0-fddbac177069 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:29.339162 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-805adaad-24ce-441d-8ba0-fddbac177069 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:29.340093 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-805adaad-24ce-441d-8ba0-fddbac177069 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:29.340422 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-805adaad-24ce-441d-8ba0-fddbac177069 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:29.340841 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-805adaad-24ce-441d-8ba0-fddbac177069 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:29.517482 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-805adaad-24ce-441d-8ba0-fddbac177069 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f931e726872474dae2b7b6fbb0eb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7bf59244bc487b84c7dbf9aa7314d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:29.534114 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-805adaad-24ce-441d-8ba0-fddbac177069 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] 10.222.0.61 "GET /compute/v2.1/servers/35d91cb7-f14b-4788-b503-ea9feaee650b" status: 200 len: 1319 microversion: 2.1 time: 0.209733 Aug 27 02:22:29.536527 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 121/239] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:22:29 2022] GET /compute/v2.1/servers/35d91cb7-f14b-4788-b503-ea9feaee650b => generated 1319 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:22:29.541161 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-3217b799-831b-4595-8cef-8f4a1ea12233 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:29.550307 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-3217b799-831b-4595-8cef-8f4a1ea12233 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/7122531d-d371-4c4c-8d9f-fc74be8649c1" status: 200 len: 1522 microversion: 2.1 time: 0.326677 Aug 27 02:22:29.550941 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 119/240] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:22:29 2022] GET /compute/v2.1/servers/7122531d-d371-4c4c-8d9f-fc74be8649c1 => generated 1522 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:22:30.557979 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-8cb720cc-ab1a-4467-bc1b-ec644041e995 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:30.558729 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-8cb720cc-ab1a-4467-bc1b-ec644041e995 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] [instance: 35d91cb7-f14b-4788-b503-ea9feaee650b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:30.566874 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8cb720cc-ab1a-4467-bc1b-ec644041e995 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:30.567660 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8cb720cc-ab1a-4467-bc1b-ec644041e995 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:30.568473 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8cb720cc-ab1a-4467-bc1b-ec644041e995 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:30.569384 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8cb720cc-ab1a-4467-bc1b-ec644041e995 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:30.569905 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8cb720cc-ab1a-4467-bc1b-ec644041e995 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:30.570328 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8cb720cc-ab1a-4467-bc1b-ec644041e995 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:30.576105 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-9e2de464-2db0-44d3-b016-3928b18a9a21 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:30.577035 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-9e2de464-2db0-44d3-b016-3928b18a9a21 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 7122531d-d371-4c4c-8d9f-fc74be8649c1] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:30.586937 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9e2de464-2db0-44d3-b016-3928b18a9a21 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:30.588111 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9e2de464-2db0-44d3-b016-3928b18a9a21 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:30.588774 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9e2de464-2db0-44d3-b016-3928b18a9a21 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:30.590098 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9e2de464-2db0-44d3-b016-3928b18a9a21 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:30.590849 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9e2de464-2db0-44d3-b016-3928b18a9a21 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:30.591727 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9e2de464-2db0-44d3-b016-3928b18a9a21 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:30.760762 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-8cb720cc-ab1a-4467-bc1b-ec644041e995 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f931e726872474dae2b7b6fbb0eb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7bf59244bc487b84c7dbf9aa7314d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:30.763005 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-9e2de464-2db0-44d3-b016-3928b18a9a21 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:30.776844 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-8cb720cc-ab1a-4467-bc1b-ec644041e995 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] 10.222.0.61 "GET /compute/v2.1/servers/35d91cb7-f14b-4788-b503-ea9feaee650b" status: 200 len: 1319 microversion: 2.1 time: 0.223100 Aug 27 02:22:30.777473 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 122/241] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:22:30 2022] GET /compute/v2.1/servers/35d91cb7-f14b-4788-b503-ea9feaee650b => generated 1319 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:22:30.778307 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-9e2de464-2db0-44d3-b016-3928b18a9a21 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/7122531d-d371-4c4c-8d9f-fc74be8649c1" status: 200 len: 1522 microversion: 2.1 time: 0.209188 Aug 27 02:22:30.779051 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 120/242] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:22:30 2022] GET /compute/v2.1/servers/7122531d-d371-4c4c-8d9f-fc74be8649c1 => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:22:31.443702 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-477798c2-4575-473f-9cac-a6bea6e2d518 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:31.444813 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-477798c2-4575-473f-9cac-a6bea6e2d518 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: 268d786c-398a-4305-85ac-545fa3b4370b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:31.454282 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-477798c2-4575-473f-9cac-a6bea6e2d518 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:31.455353 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-477798c2-4575-473f-9cac-a6bea6e2d518 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:31.456151 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-477798c2-4575-473f-9cac-a6bea6e2d518 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:31.457179 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-477798c2-4575-473f-9cac-a6bea6e2d518 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:31.457845 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-477798c2-4575-473f-9cac-a6bea6e2d518 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:31.458689 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-477798c2-4575-473f-9cac-a6bea6e2d518 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:31.490187 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell1:SELECT=100 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:22:31.503239 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-477798c2-4575-473f-9cac-a6bea6e2d518 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/268d786c-398a-4305-85ac-545fa3b4370b/ips" status: 200 len: 150 microversion: 2.1 time: 0.067581 Aug 27 02:22:31.504294 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 123/243] 10.222.0.61 () {58 vars in 1248 bytes} [Sat Aug 27 02:22:31 2022] GET /compute/v2.1/servers/268d786c-398a-4305-85ac-545fa3b4370b/ips => generated 150 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:22:31.799092 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-84b0db3d-d087-4c99-bafb-cf9ea312bfae tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:31.802665 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-84b0db3d-d087-4c99-bafb-cf9ea312bfae tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 7122531d-d371-4c4c-8d9f-fc74be8649c1] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:31.807045 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-53f9f558-b2e4-4f71-99a6-0dafeb79dd13 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:31.807841 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-53f9f558-b2e4-4f71-99a6-0dafeb79dd13 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] [instance: 35d91cb7-f14b-4788-b503-ea9feaee650b] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:31.820404 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-53f9f558-b2e4-4f71-99a6-0dafeb79dd13 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:31.822205 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-53f9f558-b2e4-4f71-99a6-0dafeb79dd13 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:31.822831 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-53f9f558-b2e4-4f71-99a6-0dafeb79dd13 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:31.823098 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-84b0db3d-d087-4c99-bafb-cf9ea312bfae tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:31.824016 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-84b0db3d-d087-4c99-bafb-cf9ea312bfae tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:31.824945 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-84b0db3d-d087-4c99-bafb-cf9ea312bfae tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:31.825980 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-84b0db3d-d087-4c99-bafb-cf9ea312bfae tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:31.826126 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-53f9f558-b2e4-4f71-99a6-0dafeb79dd13 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:31.826591 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-53f9f558-b2e4-4f71-99a6-0dafeb79dd13 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:31.826935 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-53f9f558-b2e4-4f71-99a6-0dafeb79dd13 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:31.827429 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-84b0db3d-d087-4c99-bafb-cf9ea312bfae tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:31.828193 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-84b0db3d-d087-4c99-bafb-cf9ea312bfae tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:32.104021 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-53f9f558-b2e4-4f71-99a6-0dafeb79dd13 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f931e726872474dae2b7b6fbb0eb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7bf59244bc487b84c7dbf9aa7314d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:32.113096 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-53f9f558-b2e4-4f71-99a6-0dafeb79dd13 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] 10.222.0.61 "GET /compute/v2.1/servers/35d91cb7-f14b-4788-b503-ea9feaee650b" status: 200 len: 1319 microversion: 2.1 time: 0.318295 Aug 27 02:22:32.114190 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 121/244] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:22:31 2022] GET /compute/v2.1/servers/35d91cb7-f14b-4788-b503-ea9feaee650b => generated 1319 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:22:32.146751 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-84b0db3d-d087-4c99-bafb-cf9ea312bfae tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:32.163800 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-84b0db3d-d087-4c99-bafb-cf9ea312bfae tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/7122531d-d371-4c4c-8d9f-fc74be8649c1" status: 200 len: 1522 microversion: 2.1 time: 0.369063 Aug 27 02:22:32.164890 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 124/245] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:22:31 2022] GET /compute/v2.1/servers/7122531d-d371-4c4c-8d9f-fc74be8649c1 => generated 1522 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:22:33.144916 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-ddccfd05-181b-4125-a90b-f387814157f1 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:33.148532 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-ddccfd05-181b-4125-a90b-f387814157f1 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] [instance: 35d91cb7-f14b-4788-b503-ea9feaee650b] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:33.175969 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-186abee2-55c8-4de5-a600-b4ed653ea5d2 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a6f9a924-9d70-4cd3-8d74-8de7e1d35caa"}} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:22:33.178953 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-186abee2-55c8-4de5-a600-b4ed653ea5d2 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: 268d786c-398a-4305-85ac-545fa3b4370b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:33.179085 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ddccfd05-181b-4125-a90b-f387814157f1 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:33.185286 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ddccfd05-181b-4125-a90b-f387814157f1 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:33.186469 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ddccfd05-181b-4125-a90b-f387814157f1 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:33.189511 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ddccfd05-181b-4125-a90b-f387814157f1 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:33.190222 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ddccfd05-181b-4125-a90b-f387814157f1 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:33.190908 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ddccfd05-181b-4125-a90b-f387814157f1 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:33.191061 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-186abee2-55c8-4de5-a600-b4ed653ea5d2 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:33.194263 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-186abee2-55c8-4de5-a600-b4ed653ea5d2 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:33.194922 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-186abee2-55c8-4de5-a600-b4ed653ea5d2 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:33.195851 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-186abee2-55c8-4de5-a600-b4ed653ea5d2 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:33.196748 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-186abee2-55c8-4de5-a600-b4ed653ea5d2 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:33.197413 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-186abee2-55c8-4de5-a600-b4ed653ea5d2 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:33.536975 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-ddccfd05-181b-4125-a90b-f387814157f1 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f931e726872474dae2b7b6fbb0eb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7bf59244bc487b84c7dbf9aa7314d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:33.548751 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-ddccfd05-181b-4125-a90b-f387814157f1 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] 10.222.0.61 "GET /compute/v2.1/servers/35d91cb7-f14b-4788-b503-ea9feaee650b" status: 200 len: 1319 microversion: 2.1 time: 0.416853 Aug 27 02:22:33.549953 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 122/246] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:22:33 2022] GET /compute/v2.1/servers/35d91cb7-f14b-4788-b503-ea9feaee650b => generated 1319 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:22:33.575740 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-1185b2f2-9066-435c-96e3-a59d536f8a75 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:33.582306 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-1185b2f2-9066-435c-96e3-a59d536f8a75 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 7122531d-d371-4c4c-8d9f-fc74be8649c1] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:33.592929 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1185b2f2-9066-435c-96e3-a59d536f8a75 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:33.595051 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1185b2f2-9066-435c-96e3-a59d536f8a75 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:33.595536 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1185b2f2-9066-435c-96e3-a59d536f8a75 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:33.596229 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1185b2f2-9066-435c-96e3-a59d536f8a75 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:33.596684 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1185b2f2-9066-435c-96e3-a59d536f8a75 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:33.597102 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1185b2f2-9066-435c-96e3-a59d536f8a75 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:33.685850 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-186abee2-55c8-4de5-a600-b4ed653ea5d2 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "POST /compute/v2.1/servers/268d786c-398a-4305-85ac-545fa3b4370b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.514270 Aug 27 02:22:33.686476 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 125/247] 10.222.0.61 () {60 vars in 1323 bytes} [Sat Aug 27 02:22:33 2022] POST /compute/v2.1/servers/268d786c-398a-4305-85ac-545fa3b4370b/os-volume_attachments => generated 194 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:22:33.788461 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-1185b2f2-9066-435c-96e3-a59d536f8a75 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:33.797937 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-1185b2f2-9066-435c-96e3-a59d536f8a75 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/7122531d-d371-4c4c-8d9f-fc74be8649c1" status: 200 len: 1522 microversion: 2.1 time: 0.231086 Aug 27 02:22:33.798982 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 123/248] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:22:33 2022] GET /compute/v2.1/servers/7122531d-d371-4c4c-8d9f-fc74be8649c1 => generated 1522 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:22:34.585032 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-dea6cade-4471-40a3-9bcc-d08dd7713b36 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:34.586066 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-dea6cade-4471-40a3-9bcc-d08dd7713b36 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] [instance: 35d91cb7-f14b-4788-b503-ea9feaee650b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:34.595179 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-dea6cade-4471-40a3-9bcc-d08dd7713b36 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:34.596001 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-dea6cade-4471-40a3-9bcc-d08dd7713b36 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:34.596517 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-dea6cade-4471-40a3-9bcc-d08dd7713b36 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:34.607034 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-dea6cade-4471-40a3-9bcc-d08dd7713b36 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:34.607561 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-dea6cade-4471-40a3-9bcc-d08dd7713b36 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:34.608008 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-dea6cade-4471-40a3-9bcc-d08dd7713b36 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:34.727022 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [req-e42eb59c-a259-430c-9bbb-984a4f09b92c req-e027a561-0b62-42ad-bc40-eedbbff220bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35d91cb7-f14b-4788-b503-ea9feaee650b", "name": "network-vif-plugged", "status": "completed", "tag": "09c1cd32-b4a2-4973-8cda-7a230514db53"}]} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:22:34.750388 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-e42eb59c-a259-430c-9bbb-984a4f09b92c req-e027a561-0b62-42ad-bc40-eedbbff220bb service nova] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:34.751022 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-e42eb59c-a259-430c-9bbb-984a4f09b92c req-e027a561-0b62-42ad-bc40-eedbbff220bb service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:34.751546 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-e42eb59c-a259-430c-9bbb-984a4f09b92c req-e027a561-0b62-42ad-bc40-eedbbff220bb service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:34.802148 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.compute.server_external_events [req-e42eb59c-a259-430c-9bbb-984a4f09b92c req-e027a561-0b62-42ad-bc40-eedbbff220bb service nova] Creating event network-vif-plugged:09c1cd32-b4a2-4973-8cda-7a230514db53 for instance 35d91cb7-f14b-4788-b503-ea9feaee650b on hv-cinder-84630 Aug 27 02:22:34.819530 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [req-e42eb59c-a259-430c-9bbb-984a4f09b92c req-e027a561-0b62-42ad-bc40-eedbbff220bb service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089104 Aug 27 02:22:34.820637 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 124/249] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Aug 27 02:22:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:22:34.842064 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-dea6cade-4471-40a3-9bcc-d08dd7713b36 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f931e726872474dae2b7b6fbb0eb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7bf59244bc487b84c7dbf9aa7314d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:34.843267 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-043f42d2-b462-499c-9d33-b589d371922a tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:34.844556 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-043f42d2-b462-499c-9d33-b589d371922a tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 7122531d-d371-4c4c-8d9f-fc74be8649c1] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:34.854262 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-dea6cade-4471-40a3-9bcc-d08dd7713b36 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] 10.222.0.61 "GET /compute/v2.1/servers/35d91cb7-f14b-4788-b503-ea9feaee650b" status: 200 len: 1319 microversion: 2.1 time: 0.283444 Aug 27 02:22:34.866605 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 126/250] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:22:34 2022] GET /compute/v2.1/servers/35d91cb7-f14b-4788-b503-ea9feaee650b => generated 1319 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:22:34.867133 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-043f42d2-b462-499c-9d33-b589d371922a tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:34.867133 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-043f42d2-b462-499c-9d33-b589d371922a tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:34.867133 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-043f42d2-b462-499c-9d33-b589d371922a tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:34.867133 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-043f42d2-b462-499c-9d33-b589d371922a tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:34.867433 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-043f42d2-b462-499c-9d33-b589d371922a tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:34.867433 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-043f42d2-b462-499c-9d33-b589d371922a tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:35.065208 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-043f42d2-b462-499c-9d33-b589d371922a tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:35.082212 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-043f42d2-b462-499c-9d33-b589d371922a tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/7122531d-d371-4c4c-8d9f-fc74be8649c1" status: 200 len: 1522 microversion: 2.1 time: 0.256597 Aug 27 02:22:35.083189 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 125/251] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:22:34 2022] GET /compute/v2.1/servers/7122531d-d371-4c4c-8d9f-fc74be8649c1 => generated 1522 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:22:35.877209 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-1d4e47d7-a803-4743-8a5f-d8b316c57678 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:35.878775 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-1d4e47d7-a803-4743-8a5f-d8b316c57678 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] [instance: 35d91cb7-f14b-4788-b503-ea9feaee650b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:35.887205 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1d4e47d7-a803-4743-8a5f-d8b316c57678 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:35.888138 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1d4e47d7-a803-4743-8a5f-d8b316c57678 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:35.889247 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1d4e47d7-a803-4743-8a5f-d8b316c57678 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:35.890557 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1d4e47d7-a803-4743-8a5f-d8b316c57678 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:35.891181 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1d4e47d7-a803-4743-8a5f-d8b316c57678 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:35.891697 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1d4e47d7-a803-4743-8a5f-d8b316c57678 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:35.897906 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell0:SELECT=2 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:22:35.921334 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell0:SELECT=6 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:22:36.068982 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-1d4e47d7-a803-4743-8a5f-d8b316c57678 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f931e726872474dae2b7b6fbb0eb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7bf59244bc487b84c7dbf9aa7314d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:36.080644 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-1d4e47d7-a803-4743-8a5f-d8b316c57678 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] 10.222.0.61 "GET /compute/v2.1/servers/35d91cb7-f14b-4788-b503-ea9feaee650b" status: 200 len: 1319 microversion: 2.1 time: 0.207710 Aug 27 02:22:36.081982 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-4ce58470-b209-4c1a-a3bb-deb352a186e5 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Action: 'create', calling method: .version_select at 0x7fd808684940>, body: {"keypair": {"name": "tempest-keypair-575753538", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM9QYgwuzgW9ADEJX6pL5l75Go/zwq0yJHFo0PaaBrzPAPV2uVz0C4+YA2lep5ufGYx22O6nxLZ+7gQoa70oTmA1cPJyfX9YECldtqlnSQ1bYWBRxicXSm+n2Nd9iM8yYA=="}} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:22:36.093615 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 127/252] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:22:35 2022] GET /compute/v2.1/servers/35d91cb7-f14b-4788-b503-ea9feaee650b => generated 1319 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:22:36.096440 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell0:SELECT=2 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:22:36.109035 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-2353d0bb-9f00-48c0-a5e8-36759be5df49 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:36.109622 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.quota [None req-4ce58470-b209-4c1a-a3bb-deb352a186e5 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Getting quotas for project 8aa1c411b57d4e72885dac2b4f4dfe7a. Resources: {'key_pairs'} {{(pid=120783) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:22:36.110876 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-2353d0bb-9f00-48c0-a5e8-36759be5df49 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 7122531d-d371-4c4c-8d9f-fc74be8649c1] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:36.114764 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.quota [None req-4ce58470-b209-4c1a-a3bb-deb352a186e5 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Getting quotas for user 4a6f819365574091ae344f14e47f487f and project 8aa1c411b57d4e72885dac2b4f4dfe7a. Resources: {'key_pairs'} {{(pid=120783) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:22:36.120915 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2353d0bb-9f00-48c0-a5e8-36759be5df49 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:36.122272 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2353d0bb-9f00-48c0-a5e8-36759be5df49 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:36.123026 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2353d0bb-9f00-48c0-a5e8-36759be5df49 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:36.123963 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2353d0bb-9f00-48c0-a5e8-36759be5df49 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:36.124687 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2353d0bb-9f00-48c0-a5e8-36759be5df49 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:36.125383 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2353d0bb-9f00-48c0-a5e8-36759be5df49 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:36.153179 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-4ce58470-b209-4c1a-a3bb-deb352a186e5 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.078504 Aug 27 02:22:36.159772 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 126/253] 10.222.0.61 () {60 vars in 1159 bytes} [Sat Aug 27 02:22:36 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:22:36.400114 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-2353d0bb-9f00-48c0-a5e8-36759be5df49 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:36.410105 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-2353d0bb-9f00-48c0-a5e8-36759be5df49 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/7122531d-d371-4c4c-8d9f-fc74be8649c1" status: 200 len: 1522 microversion: 2.1 time: 0.309142 Aug 27 02:22:36.410772 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 128/254] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:22:36 2022] GET /compute/v2.1/servers/7122531d-d371-4c4c-8d9f-fc74be8649c1 => generated 1522 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:22:36.869673 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-f0130cc2-8e63-4cf3-b4c3-a5382ed8b6c0 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:36.870190 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-f0130cc2-8e63-4cf3-b4c3-a5382ed8b6c0 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:36.877889 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f0130cc2-8e63-4cf3-b4c3-a5382ed8b6c0 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:36.878607 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f0130cc2-8e63-4cf3-b4c3-a5382ed8b6c0 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:36.879097 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f0130cc2-8e63-4cf3-b4c3-a5382ed8b6c0 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:36.880069 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f0130cc2-8e63-4cf3-b4c3-a5382ed8b6c0 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:36.880584 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f0130cc2-8e63-4cf3-b4c3-a5382ed8b6c0 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:36.881011 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f0130cc2-8e63-4cf3-b4c3-a5382ed8b6c0 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:36.908895 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-f0130cc2-8e63-4cf3-b4c3-a5382ed8b6c0 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db/ips" status: 200 len: 150 microversion: 2.20 time: 0.043654 Aug 27 02:22:36.909483 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 127/255] 10.222.0.61 () {60 vars in 1289 bytes} [Sat Aug 27 02:22:36 2022] GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db/ips => generated 150 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:22:37.111271 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-3e61c334-cdc9-426b-8362-889cb9a42e8c tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:37.114875 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-3e61c334-cdc9-426b-8362-889cb9a42e8c tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] [instance: 35d91cb7-f14b-4788-b503-ea9feaee650b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:37.130019 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:22:37.135133 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3e61c334-cdc9-426b-8362-889cb9a42e8c tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:37.135568 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3e61c334-cdc9-426b-8362-889cb9a42e8c tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:37.137802 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3e61c334-cdc9-426b-8362-889cb9a42e8c tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:37.141675 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3e61c334-cdc9-426b-8362-889cb9a42e8c tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:37.142540 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3e61c334-cdc9-426b-8362-889cb9a42e8c tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:37.143404 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3e61c334-cdc9-426b-8362-889cb9a42e8c tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:37.339413 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-3e61c334-cdc9-426b-8362-889cb9a42e8c tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f931e726872474dae2b7b6fbb0eb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7bf59244bc487b84c7dbf9aa7314d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:37.352711 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-3e61c334-cdc9-426b-8362-889cb9a42e8c tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] 10.222.0.61 "GET /compute/v2.1/servers/35d91cb7-f14b-4788-b503-ea9feaee650b" status: 200 len: 1508 microversion: 2.1 time: 0.253003 Aug 27 02:22:37.355239 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 129/256] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:22:37 2022] GET /compute/v2.1/servers/35d91cb7-f14b-4788-b503-ea9feaee650b => generated 1508 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:22:37.434000 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-5888f6fa-83a7-4c87-88e0-b5d45a7fefbb tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:37.435468 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-5888f6fa-83a7-4c87-88e0-b5d45a7fefbb tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 7122531d-d371-4c4c-8d9f-fc74be8649c1] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:37.462268 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5888f6fa-83a7-4c87-88e0-b5d45a7fefbb tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:37.472700 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5888f6fa-83a7-4c87-88e0-b5d45a7fefbb tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:37.474586 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5888f6fa-83a7-4c87-88e0-b5d45a7fefbb tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:37.477839 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5888f6fa-83a7-4c87-88e0-b5d45a7fefbb tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:37.478385 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5888f6fa-83a7-4c87-88e0-b5d45a7fefbb tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:37.478940 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5888f6fa-83a7-4c87-88e0-b5d45a7fefbb tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:37.772499 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-5888f6fa-83a7-4c87-88e0-b5d45a7fefbb tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:37.798021 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-5888f6fa-83a7-4c87-88e0-b5d45a7fefbb tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/7122531d-d371-4c4c-8d9f-fc74be8649c1" status: 200 len: 1522 microversion: 2.1 time: 0.369051 Aug 27 02:22:37.799784 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 128/257] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:22:37 2022] GET /compute/v2.1/servers/7122531d-d371-4c4c-8d9f-fc74be8649c1 => generated 1522 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:22:38.080183 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-76d157c1-e634-41b8-bbcc-9f4a521b72f6 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1112779058", "imageRef": "7d45cdd6-750f-40c7-9475-f7bf12fcb204", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0a6b16e1-c045-4fdd-a4f5-57e1f8fdda65"}], "security_groups": [{"name": "tempest-securitygroup--1542396383"}], "key_name": "tempest-keypair-575753538", "user_data": "}} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:22:38.195922 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.network.neutron [None req-76d157c1-e634-41b8-bbcc-9f4a521b72f6 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] validate_networks() for [('0a6b16e1-c045-4fdd-a4f5-57e1f8fdda65', None, None, None, None, None)] {{(pid=120782) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:22:38.706883 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-76d157c1-e634-41b8-bbcc-9f4a521b72f6 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Flavor limits 0:0:0 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:22:38.707705 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-76d157c1-e634-41b8-bbcc-9f4a521b72f6 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Image limits 0:0:0 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:22:38.708317 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-76d157c1-e634-41b8-bbcc-9f4a521b72f6 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Flavor pref 0:0:0 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:22:38.709263 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-76d157c1-e634-41b8-bbcc-9f4a521b72f6 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Image pref 0:0:0 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:22:38.709994 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-76d157c1-e634-41b8-bbcc-9f4a521b72f6 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:22:38.719881 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-76d157c1-e634-41b8-bbcc-9f4a521b72f6 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:38.720443 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-76d157c1-e634-41b8-bbcc-9f4a521b72f6 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:38.721136 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-76d157c1-e634-41b8-bbcc-9f4a521b72f6 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:38.722202 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-76d157c1-e634-41b8-bbcc-9f4a521b72f6 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:38.722672 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-76d157c1-e634-41b8-bbcc-9f4a521b72f6 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:38.723342 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-76d157c1-e634-41b8-bbcc-9f4a521b72f6 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:38.743123 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.quota [None req-76d157c1-e634-41b8-bbcc-9f4a521b72f6 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Getting quotas for project 8aa1c411b57d4e72885dac2b4f4dfe7a. Resources: {'instances', 'ram', 'cores'} {{(pid=120782) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:22:38.750350 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.quota [None req-76d157c1-e634-41b8-bbcc-9f4a521b72f6 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Getting quotas for user 4a6f819365574091ae344f14e47f487f and project 8aa1c411b57d4e72885dac2b4f4dfe7a. Resources: {'instances', 'ram', 'cores'} {{(pid=120782) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:22:38.778352 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-76d157c1-e634-41b8-bbcc-9f4a521b72f6 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Going to run 1 instances... {{(pid=120782) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:22:38.780682 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-76d157c1-e634-41b8-bbcc-9f4a521b72f6 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: d5c72277-dabd-484c-9e20-279b6159516a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7d45cdd6-750f-40c7-9475-f7bf12fcb204',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120782) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:22:38.838792 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-d4f7d52b-6a9a-49a3-bd66-631bbb13485f tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:38.839406 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-d4f7d52b-6a9a-49a3-bd66-631bbb13485f tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 7122531d-d371-4c4c-8d9f-fc74be8649c1] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:38.861029 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d4f7d52b-6a9a-49a3-bd66-631bbb13485f tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:38.862101 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d4f7d52b-6a9a-49a3-bd66-631bbb13485f tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:38.862746 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d4f7d52b-6a9a-49a3-bd66-631bbb13485f tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:38.864229 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d4f7d52b-6a9a-49a3-bd66-631bbb13485f tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:38.865098 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d4f7d52b-6a9a-49a3-bd66-631bbb13485f tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:38.866393 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d4f7d52b-6a9a-49a3-bd66-631bbb13485f tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:38.873949 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-76d157c1-e634-41b8-bbcc-9f4a521b72f6 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.797782 Aug 27 02:22:38.880424 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 130/258] 10.222.0.61 () {60 vars in 1147 bytes} [Sat Aug 27 02:22:38 2022] POST /compute/v2.1/servers => generated 402 bytes in 805 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:22:38.897104 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-6428d83f-3525-4971-96ae-8714eec72800 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:38.906716 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-6428d83f-3525-4971-96ae-8714eec72800 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: d5c72277-dabd-484c-9e20-279b6159516a] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:38.998712 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-6428d83f-3525-4971-96ae-8714eec72800 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6f819365574091ae344f14e47f487f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa1c411b57d4e72885dac2b4f4dfe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:39.007494 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-6428d83f-3525-4971-96ae-8714eec72800 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/d5c72277-dabd-484c-9e20-279b6159516a" status: 200 len: 1241 microversion: 2.1 time: 0.120673 Aug 27 02:22:39.008087 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 131/259] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:22:38 2022] GET /compute/v2.1/servers/d5c72277-dabd-484c-9e20-279b6159516a => generated 1241 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:22:39.104252 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-d4f7d52b-6a9a-49a3-bd66-631bbb13485f tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:39.115147 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-d4f7d52b-6a9a-49a3-bd66-631bbb13485f tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/7122531d-d371-4c4c-8d9f-fc74be8649c1" status: 200 len: 1522 microversion: 2.1 time: 0.298085 Aug 27 02:22:39.116224 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 129/260] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:22:38 2022] GET /compute/v2.1/servers/7122531d-d371-4c4c-8d9f-fc74be8649c1 => generated 1522 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:22:40.025147 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-efc457ca-2191-4fe5-9220-e2a99eb1069b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:22:40.029434 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-efc457ca-2191-4fe5-9220-e2a99eb1069b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:40.030497 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-a99f68d9-e637-4bcb-849a-6966aa96c4af tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:40.031106 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-a99f68d9-e637-4bcb-849a-6966aa96c4af tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: d5c72277-dabd-484c-9e20-279b6159516a] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:40.037154 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-efc457ca-2191-4fe5-9220-e2a99eb1069b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:40.038027 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-efc457ca-2191-4fe5-9220-e2a99eb1069b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:40.038655 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-efc457ca-2191-4fe5-9220-e2a99eb1069b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:40.038827 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a99f68d9-e637-4bcb-849a-6966aa96c4af tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:40.039158 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a99f68d9-e637-4bcb-849a-6966aa96c4af tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:40.039556 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a99f68d9-e637-4bcb-849a-6966aa96c4af tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:40.039707 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-efc457ca-2191-4fe5-9220-e2a99eb1069b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:40.040246 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a99f68d9-e637-4bcb-849a-6966aa96c4af tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:40.040584 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-efc457ca-2191-4fe5-9220-e2a99eb1069b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:40.040731 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a99f68d9-e637-4bcb-849a-6966aa96c4af tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:40.041088 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a99f68d9-e637-4bcb-849a-6966aa96c4af tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:40.041882 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-efc457ca-2191-4fe5-9220-e2a99eb1069b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:40.071650 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.objects.instance [None req-efc457ca-2191-4fe5-9220-e2a99eb1069b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lazy-loading 'flavor' on Instance uuid 47d706cc-4f9b-4d59-8eca-caae165ec5db {{(pid=120782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:22:40.116109 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-a99f68d9-e637-4bcb-849a-6966aa96c4af tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6f819365574091ae344f14e47f487f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa1c411b57d4e72885dac2b4f4dfe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:40.124695 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-a99f68d9-e637-4bcb-849a-6966aa96c4af tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/d5c72277-dabd-484c-9e20-279b6159516a" status: 200 len: 1245 microversion: 2.1 time: 0.098126 Aug 27 02:22:40.125437 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 130/261] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:22:40 2022] GET /compute/v2.1/servers/d5c72277-dabd-484c-9e20-279b6159516a => generated 1245 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:22:40.146513 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-f1de4659-b6fb-4e5b-9431-1348efd99d44 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:40.147438 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-f1de4659-b6fb-4e5b-9431-1348efd99d44 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 7122531d-d371-4c4c-8d9f-fc74be8649c1] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:40.155945 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f1de4659-b6fb-4e5b-9431-1348efd99d44 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:40.156675 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f1de4659-b6fb-4e5b-9431-1348efd99d44 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:40.157279 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f1de4659-b6fb-4e5b-9431-1348efd99d44 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:40.158875 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f1de4659-b6fb-4e5b-9431-1348efd99d44 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:40.159503 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f1de4659-b6fb-4e5b-9431-1348efd99d44 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:40.160903 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f1de4659-b6fb-4e5b-9431-1348efd99d44 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:40.332501 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-efc457ca-2191-4fe5-9220-e2a99eb1069b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "POST /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db/action" status: 202 len: 0 microversion: 2.20 time: 0.311566 Aug 27 02:22:40.334073 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 132/262] 10.222.0.61 () {62 vars in 1319 bytes} [Sat Aug 27 02:22:40 2022] POST /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db/action => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 27 02:22:40.343485 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-56374307-f66e-4bbe-a329-b461bc7f9ecd tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:40.344581 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-56374307-f66e-4bbe-a329-b461bc7f9ecd tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:40.351509 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-f1de4659-b6fb-4e5b-9431-1348efd99d44 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:40.352926 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-56374307-f66e-4bbe-a329-b461bc7f9ecd tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:40.353564 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-56374307-f66e-4bbe-a329-b461bc7f9ecd tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:40.354212 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-56374307-f66e-4bbe-a329-b461bc7f9ecd tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:40.355598 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-56374307-f66e-4bbe-a329-b461bc7f9ecd tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:40.366063 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-f1de4659-b6fb-4e5b-9431-1348efd99d44 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/7122531d-d371-4c4c-8d9f-fc74be8649c1" status: 200 len: 1522 microversion: 2.1 time: 0.222004 Aug 27 02:22:40.366063 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 131/263] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:22:40 2022] GET /compute/v2.1/servers/7122531d-d371-4c4c-8d9f-fc74be8649c1 => generated 1522 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:22:40.366345 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-56374307-f66e-4bbe-a329-b461bc7f9ecd tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:40.367828 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-56374307-f66e-4bbe-a329-b461bc7f9ecd tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:40.524845 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-56374307-f66e-4bbe-a329-b461bc7f9ecd tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:40.536133 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-56374307-f66e-4bbe-a329-b461bc7f9ecd tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:40.536465 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-56374307-f66e-4bbe-a329-b461bc7f9ecd tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:40.537710 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-56374307-f66e-4bbe-a329-b461bc7f9ecd tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db" status: 200 len: 1722 microversion: 2.20 time: 0.199644 Aug 27 02:22:40.538436 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 133/264] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:22:40 2022] GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db => generated 1722 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:22:41.148694 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-1675c0f7-9c43-4d76-bcc5-24c917c44722 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:41.149348 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-1675c0f7-9c43-4d76-bcc5-24c917c44722 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: d5c72277-dabd-484c-9e20-279b6159516a] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:41.158665 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1675c0f7-9c43-4d76-bcc5-24c917c44722 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:41.159500 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1675c0f7-9c43-4d76-bcc5-24c917c44722 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:41.160332 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1675c0f7-9c43-4d76-bcc5-24c917c44722 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:41.161220 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1675c0f7-9c43-4d76-bcc5-24c917c44722 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:41.162069 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1675c0f7-9c43-4d76-bcc5-24c917c44722 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:41.162829 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1675c0f7-9c43-4d76-bcc5-24c917c44722 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:41.265068 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-1675c0f7-9c43-4d76-bcc5-24c917c44722 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6f819365574091ae344f14e47f487f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa1c411b57d4e72885dac2b4f4dfe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:41.282673 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-1675c0f7-9c43-4d76-bcc5-24c917c44722 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/d5c72277-dabd-484c-9e20-279b6159516a" status: 200 len: 1237 microversion: 2.1 time: 0.138158 Aug 27 02:22:41.283590 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 132/265] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:22:41 2022] GET /compute/v2.1/servers/d5c72277-dabd-484c-9e20-279b6159516a => generated 1237 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:22:41.385719 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-9b406276-56a1-47a4-b679-0f5db37f9ee3 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:41.386357 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-9b406276-56a1-47a4-b679-0f5db37f9ee3 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 7122531d-d371-4c4c-8d9f-fc74be8649c1] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:41.393566 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9b406276-56a1-47a4-b679-0f5db37f9ee3 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:41.394052 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9b406276-56a1-47a4-b679-0f5db37f9ee3 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:41.394483 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9b406276-56a1-47a4-b679-0f5db37f9ee3 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:41.395209 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9b406276-56a1-47a4-b679-0f5db37f9ee3 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:41.395661 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9b406276-56a1-47a4-b679-0f5db37f9ee3 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:41.396052 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9b406276-56a1-47a4-b679-0f5db37f9ee3 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:41.565162 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-ec7f6df9-88ad-495a-bee2-441479432cd8 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:41.566076 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-ec7f6df9-88ad-495a-bee2-441479432cd8 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:41.574437 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ec7f6df9-88ad-495a-bee2-441479432cd8 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:41.593967 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ec7f6df9-88ad-495a-bee2-441479432cd8 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:41.594501 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ec7f6df9-88ad-495a-bee2-441479432cd8 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:41.596777 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ec7f6df9-88ad-495a-bee2-441479432cd8 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:41.597313 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ec7f6df9-88ad-495a-bee2-441479432cd8 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:41.597781 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ec7f6df9-88ad-495a-bee2-441479432cd8 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:41.602002 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-9b406276-56a1-47a4-b679-0f5db37f9ee3 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:41.629255 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-9b406276-56a1-47a4-b679-0f5db37f9ee3 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/7122531d-d371-4c4c-8d9f-fc74be8649c1" status: 200 len: 1522 microversion: 2.1 time: 0.246052 Aug 27 02:22:41.652223 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 134/266] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:22:41 2022] GET /compute/v2.1/servers/7122531d-d371-4c4c-8d9f-fc74be8649c1 => generated 1522 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:22:41.815973 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-ec7f6df9-88ad-495a-bee2-441479432cd8 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:41.825085 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-ec7f6df9-88ad-495a-bee2-441479432cd8 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:41.826785 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-ec7f6df9-88ad-495a-bee2-441479432cd8 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:41.828243 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-ec7f6df9-88ad-495a-bee2-441479432cd8 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db" status: 200 len: 1722 microversion: 2.20 time: 0.268288 Aug 27 02:22:41.828860 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 133/267] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:22:41 2022] GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db => generated 1722 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:22:42.308110 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-0d636cac-1a6a-4538-ac0e-02bde8424a5f tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:42.309152 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-0d636cac-1a6a-4538-ac0e-02bde8424a5f tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: d5c72277-dabd-484c-9e20-279b6159516a] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:42.317163 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0d636cac-1a6a-4538-ac0e-02bde8424a5f tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:42.318024 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0d636cac-1a6a-4538-ac0e-02bde8424a5f tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:42.318673 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0d636cac-1a6a-4538-ac0e-02bde8424a5f tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:42.319615 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0d636cac-1a6a-4538-ac0e-02bde8424a5f tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:42.320260 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0d636cac-1a6a-4538-ac0e-02bde8424a5f tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:42.320867 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0d636cac-1a6a-4538-ac0e-02bde8424a5f tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:42.410586 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-0d636cac-1a6a-4538-ac0e-02bde8424a5f tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6f819365574091ae344f14e47f487f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa1c411b57d4e72885dac2b4f4dfe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:42.419987 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-0d636cac-1a6a-4538-ac0e-02bde8424a5f tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/d5c72277-dabd-484c-9e20-279b6159516a" status: 200 len: 1293 microversion: 2.1 time: 0.117785 Aug 27 02:22:42.421053 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 135/268] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:22:42 2022] GET /compute/v2.1/servers/d5c72277-dabd-484c-9e20-279b6159516a => generated 1293 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:22:42.659443 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-2b300bd3-7c6b-48c3-86a7-fbaf585c63e8 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:42.660282 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-2b300bd3-7c6b-48c3-86a7-fbaf585c63e8 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 7122531d-d371-4c4c-8d9f-fc74be8649c1] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:42.684151 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2b300bd3-7c6b-48c3-86a7-fbaf585c63e8 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:42.684765 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2b300bd3-7c6b-48c3-86a7-fbaf585c63e8 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:42.685314 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2b300bd3-7c6b-48c3-86a7-fbaf585c63e8 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:42.686312 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2b300bd3-7c6b-48c3-86a7-fbaf585c63e8 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:42.686954 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2b300bd3-7c6b-48c3-86a7-fbaf585c63e8 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:42.687542 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2b300bd3-7c6b-48c3-86a7-fbaf585c63e8 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:42.708247 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell1:SELECT=100 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:22:42.856328 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-df2ef28a-6017-43a8-8fe1-586b747f4ebe tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:42.856328 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-df2ef28a-6017-43a8-8fe1-586b747f4ebe tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:42.863684 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-df2ef28a-6017-43a8-8fe1-586b747f4ebe tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:42.868654 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-df2ef28a-6017-43a8-8fe1-586b747f4ebe tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:42.869195 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-df2ef28a-6017-43a8-8fe1-586b747f4ebe tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:42.888842 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-df2ef28a-6017-43a8-8fe1-586b747f4ebe tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:42.889430 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-df2ef28a-6017-43a8-8fe1-586b747f4ebe tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:42.889946 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-df2ef28a-6017-43a8-8fe1-586b747f4ebe tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:42.984231 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-2b300bd3-7c6b-48c3-86a7-fbaf585c63e8 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:42.998109 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-2b300bd3-7c6b-48c3-86a7-fbaf585c63e8 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/7122531d-d371-4c4c-8d9f-fc74be8649c1" status: 200 len: 1522 microversion: 2.1 time: 0.341254 Aug 27 02:22:42.999581 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 134/269] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:22:42 2022] GET /compute/v2.1/servers/7122531d-d371-4c4c-8d9f-fc74be8649c1 => generated 1522 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:22:43.133261 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-df2ef28a-6017-43a8-8fe1-586b747f4ebe tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:43.146527 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-df2ef28a-6017-43a8-8fe1-586b747f4ebe tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:43.147964 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-df2ef28a-6017-43a8-8fe1-586b747f4ebe tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:43.149143 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-df2ef28a-6017-43a8-8fe1-586b747f4ebe tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db" status: 200 len: 1722 microversion: 2.20 time: 0.300940 Aug 27 02:22:43.149899 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 136/270] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:22:42 2022] GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db => generated 1722 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:22:43.442807 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-0c1151c7-27a1-4d43-9f13-1742a55dfa2b tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:43.443510 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-0c1151c7-27a1-4d43-9f13-1742a55dfa2b tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: d5c72277-dabd-484c-9e20-279b6159516a] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:43.450500 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0c1151c7-27a1-4d43-9f13-1742a55dfa2b tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:43.450999 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0c1151c7-27a1-4d43-9f13-1742a55dfa2b tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:43.451699 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0c1151c7-27a1-4d43-9f13-1742a55dfa2b tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:43.452562 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0c1151c7-27a1-4d43-9f13-1742a55dfa2b tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:43.453040 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0c1151c7-27a1-4d43-9f13-1742a55dfa2b tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:43.453921 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0c1151c7-27a1-4d43-9f13-1742a55dfa2b tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:43.524971 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-0c1151c7-27a1-4d43-9f13-1742a55dfa2b tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6f819365574091ae344f14e47f487f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa1c411b57d4e72885dac2b4f4dfe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:43.533644 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-0c1151c7-27a1-4d43-9f13-1742a55dfa2b tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/d5c72277-dabd-484c-9e20-279b6159516a" status: 200 len: 1301 microversion: 2.1 time: 0.094619 Aug 27 02:22:43.534223 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 135/271] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:22:43 2022] GET /compute/v2.1/servers/d5c72277-dabd-484c-9e20-279b6159516a => generated 1301 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:22:43.717609 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-ee2ebd40-9a6c-4513-9016-d40dd435c222 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:43.720996 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-ee2ebd40-9a6c-4513-9016-d40dd435c222 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 4fedf0d1-cc1c-4947-b92e-dcb4454889d1] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:43.733549 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ee2ebd40-9a6c-4513-9016-d40dd435c222 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:43.734708 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ee2ebd40-9a6c-4513-9016-d40dd435c222 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:43.735645 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ee2ebd40-9a6c-4513-9016-d40dd435c222 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:43.736893 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ee2ebd40-9a6c-4513-9016-d40dd435c222 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:43.737665 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ee2ebd40-9a6c-4513-9016-d40dd435c222 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:43.738352 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ee2ebd40-9a6c-4513-9016-d40dd435c222 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:43.785022 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-ee2ebd40-9a6c-4513-9016-d40dd435c222 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1/ips" status: 200 len: 144 microversion: 2.1 time: 0.075711 Aug 27 02:22:43.786298 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 137/272] 10.222.0.61 () {58 vars in 1248 bytes} [Sat Aug 27 02:22:43 2022] GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1/ips => generated 144 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:22:44.022287 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-0fee65c1-76a4-4814-920a-9ba80671075a tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:44.022903 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-0fee65c1-76a4-4814-920a-9ba80671075a tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 7122531d-d371-4c4c-8d9f-fc74be8649c1] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:44.031152 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0fee65c1-76a4-4814-920a-9ba80671075a tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:44.031644 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0fee65c1-76a4-4814-920a-9ba80671075a tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:44.032072 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0fee65c1-76a4-4814-920a-9ba80671075a tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:44.033011 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0fee65c1-76a4-4814-920a-9ba80671075a tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:44.033746 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0fee65c1-76a4-4814-920a-9ba80671075a tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:44.034175 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0fee65c1-76a4-4814-920a-9ba80671075a tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:44.175228 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-8941a26f-3f8d-44f4-8170-e530037a7412 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:44.175830 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-8941a26f-3f8d-44f4-8170-e530037a7412 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:44.183888 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8941a26f-3f8d-44f4-8170-e530037a7412 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:44.184543 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8941a26f-3f8d-44f4-8170-e530037a7412 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:44.185270 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8941a26f-3f8d-44f4-8170-e530037a7412 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:44.186270 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8941a26f-3f8d-44f4-8170-e530037a7412 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:44.186879 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8941a26f-3f8d-44f4-8170-e530037a7412 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:44.187437 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8941a26f-3f8d-44f4-8170-e530037a7412 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:44.362166 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-0fee65c1-76a4-4814-920a-9ba80671075a tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:44.366402 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-0fee65c1-76a4-4814-920a-9ba80671075a tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/7122531d-d371-4c4c-8d9f-fc74be8649c1" status: 200 len: 1502 microversion: 2.1 time: 0.349796 Aug 27 02:22:44.381828 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 136/273] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:22:44 2022] GET /compute/v2.1/servers/7122531d-d371-4c4c-8d9f-fc74be8649c1 => generated 1502 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:22:44.391254 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-d5802069-2259-40d9-8322-3a8bcc84bd38 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4767e1fa-6476-44d7-8f96-791b1208536a"}} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:22:44.395239 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-d5802069-2259-40d9-8322-3a8bcc84bd38 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 7122531d-d371-4c4c-8d9f-fc74be8649c1] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:44.402951 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d5802069-2259-40d9-8322-3a8bcc84bd38 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:44.403865 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d5802069-2259-40d9-8322-3a8bcc84bd38 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:44.404760 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d5802069-2259-40d9-8322-3a8bcc84bd38 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:44.406004 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d5802069-2259-40d9-8322-3a8bcc84bd38 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:44.406808 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d5802069-2259-40d9-8322-3a8bcc84bd38 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:44.407513 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d5802069-2259-40d9-8322-3a8bcc84bd38 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:44.486692 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.wsgi [None req-d5802069-2259-40d9-8322-3a8bcc84bd38 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] HTTP exception thrown: Cannot 'attach_volume' instance 7122531d-d371-4c4c-8d9f-fc74be8649c1 while it is in vm_state rescued Aug 27 02:22:44.487832 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-8941a26f-3f8d-44f4-8170-e530037a7412 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:44.489044 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-d5802069-2259-40d9-8322-3a8bcc84bd38 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Request method failure captured: Aug 27 02:22:44.489044 dv-cinder-846303-3-smb devstack@n-api.service[120783]: request: POST /compute/v2.1/servers/7122531d-d371-4c4c-8d9f-fc74be8649c1/os-volume_attachments HTTP/1.1 Aug 27 02:22:44.489044 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Accept: application/json Aug 27 02:22:44.489044 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Accept-Encoding: identity Aug 27 02:22:44.489044 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Connection: close Aug 27 02:22:44.489044 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Content-Length: 74 Aug 27 02:22:44.489044 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Content-Type: application/json Aug 27 02:22:44.489044 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Host: 10.222.0.61 Aug 27 02:22:44.489044 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Openstack-System-Scope: None Aug 27 02:22:44.489044 dv-cinder-846303-3-smb devstack@n-api.service[120783]: User-Agent: python-urllib3/1.26.11 Aug 27 02:22:44.489044 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Auth-Token: gAAAAABjCX-CxsQboupe7LGVgMB3IvNk6DZKE8jyi_9nbzm-Wvf3iOAH1nHoxh235cCKiWLsOX-TSw1YO5xdAHVdx_5iwsz77LAdzGTVwjuAfG2PP9Jsj1PrgoZ4Q6XQRHgC6UAoTOMizINS2RlKs2CbHJ_FMN6pGKDTXTr1l-0RRb1mYFgkHEU Aug 27 02:22:44.489044 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Domain-Id: None Aug 27 02:22:44.489044 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Domain-Name: None Aug 27 02:22:44.489044 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Identity-Status: Confirmed Aug 27 02:22:44.489044 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Is-Admin-Project: True Aug 27 02:22:44.489044 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Project-Domain-Id: default Aug 27 02:22:44.489044 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Project-Domain-Name: Default Aug 27 02:22:44.489044 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Project-Id: 67209b74f2fa4ae7ad9762d141378a5d Aug 27 02:22:44.489044 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1743925357 Aug 27 02:22:44.489044 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Role: member,reader Aug 27 02:22:44.489044 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Roles: member,reader Aug 27 02:22:44.490502 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/67209b74f2fa4ae7ad9762d141378a5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_67209b74f2fa4ae7ad9762d141378a5d", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/67209b74f2fa4ae7ad9762d141378a5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/67209b74f2fa4ae7ad9762d141378a5d"}]}] Aug 27 02:22:44.490502 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1743925357 Aug 27 02:22:44.490502 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Tenant-Id: 67209b74f2fa4ae7ad9762d141378a5d Aug 27 02:22:44.490502 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1743925357 Aug 27 02:22:44.490502 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User: tempest-ServerRescueNegativeTestJSON-1743925357-project Aug 27 02:22:44.490502 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User-Domain-Id: default Aug 27 02:22:44.490502 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User-Domain-Name: Default Aug 27 02:22:44.490502 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User-Id: 1eb664209056410d890d1b2b8bfa0155 Aug 27 02:22:44.490502 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1743925357-project Aug 27 02:22:44.490502 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Aug 27 02:22:44.490502 dv-cinder-846303-3-smb devstack@n-api.service[120783]: {"volumeAttachment": {"volumeId": "4767e1fa-6476-44d7-8f96-791b1208536a"}} Aug 27 02:22:44.490502 dv-cinder-846303-3-smb devstack@n-api.service[120783]: method: > Aug 27 02:22:44.491169 dv-cinder-846303-3-smb devstack@n-api.service[120783]: exception: Cannot 'attach_volume' instance 7122531d-d371-4c4c-8d9f-fc74be8649c1 while it is in vm_state rescued Aug 27 02:22:44.491169 dv-cinder-846303-3-smb devstack@n-api.service[120783]: action_args: {'server_id': '7122531d-d371-4c4c-8d9f-fc74be8649c1', 'body': {'volumeAttachment': {'volumeId': '4767e1fa-6476-44d7-8f96-791b1208536a'}}} Aug 27 02:22:44.491169 dv-cinder-846303-3-smb devstack@n-api.service[120783]: {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:22:44.491169 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:22:44.491169 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 27 02:22:44.491169 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 27 02:22:44.491169 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 02:22:44.491169 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 02:22:44.491169 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 27 02:22:44.491169 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 27 02:22:44.491169 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7122531d-d371-4c4c-8d9f-fc74be8649c1 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 27 02:22:44.491169 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:22:44.491169 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:22:44.491169 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:22:44.491169 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:22:44.491169 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:22:44.491169 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:22:44.491169 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:22:44.491169 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:22:44.492249 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:22:44.492249 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:22:44.492249 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:22:44.492249 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:22:44.492249 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:22:44.492249 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:22:44.492249 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:22:44.492249 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:22:44.492249 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 27 02:22:44.492249 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 27 02:22:44.492249 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 27 02:22:44.492249 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 27 02:22:44.492249 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 7122531d-d371-4c4c-8d9f-fc74be8649c1 while it is in vm_state rescued Aug 27 02:22:44.492249 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:22:44.492249 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:22:44.492249 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:22:44.492249 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:22:44.492249 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:22:44.492249 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:22:44.493252 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:22:44.493252 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:22:44.493252 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 7122531d-d371-4c4c-8d9f-fc74be8649c1 while it is in vm_state rescued Aug 27 02:22:44.493252 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:22:44.493252 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-d5802069-2259-40d9-8322-3a8bcc84bd38 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Returning 409 to user: Cannot 'attach_volume' instance 7122531d-d371-4c4c-8d9f-fc74be8649c1 while it is in vm_state rescued {{(pid=120783) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:22:44.493252 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-d5802069-2259-40d9-8322-3a8bcc84bd38 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "POST /compute/v2.1/servers/7122531d-d371-4c4c-8d9f-fc74be8649c1/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.105561 Aug 27 02:22:44.493252 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 137/274] 10.222.0.61 () {60 vars in 1323 bytes} [Sat Aug 27 02:22:44 2022] POST /compute/v2.1/servers/7122531d-d371-4c4c-8d9f-fc74be8649c1/os-volume_attachments => generated 152 bytes in 107 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 27 02:22:44.507732 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-8941a26f-3f8d-44f4-8170-e530037a7412 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:44.512126 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-8941a26f-3f8d-44f4-8170-e530037a7412 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:44.513950 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-b0935182-99af-495e-9876-926d6aeb0d82 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:22:44.514961 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-8941a26f-3f8d-44f4-8170-e530037a7412 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db" status: 200 len: 1722 microversion: 2.20 time: 0.345891 Aug 27 02:22:44.518900 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 138/275] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:22:44 2022] GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db => generated 1722 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:22:44.521751 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-b0935182-99af-495e-9876-926d6aeb0d82 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 7122531d-d371-4c4c-8d9f-fc74be8649c1] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:44.539652 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b0935182-99af-495e-9876-926d6aeb0d82 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:44.540374 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b0935182-99af-495e-9876-926d6aeb0d82 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:44.540803 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b0935182-99af-495e-9876-926d6aeb0d82 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:44.542012 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b0935182-99af-495e-9876-926d6aeb0d82 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:44.542756 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b0935182-99af-495e-9876-926d6aeb0d82 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:44.543331 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b0935182-99af-495e-9876-926d6aeb0d82 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:44.557496 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-e81fa2ce-8320-42f5-90bf-bc46b7c8da61 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:44.559199 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-e81fa2ce-8320-42f5-90bf-bc46b7c8da61 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: d5c72277-dabd-484c-9e20-279b6159516a] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:44.567107 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e81fa2ce-8320-42f5-90bf-bc46b7c8da61 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:44.567871 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e81fa2ce-8320-42f5-90bf-bc46b7c8da61 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:44.569281 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e81fa2ce-8320-42f5-90bf-bc46b7c8da61 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:44.570835 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e81fa2ce-8320-42f5-90bf-bc46b7c8da61 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:44.571986 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e81fa2ce-8320-42f5-90bf-bc46b7c8da61 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:44.572620 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e81fa2ce-8320-42f5-90bf-bc46b7c8da61 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:44.578433 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:22:44.644645 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-b0935182-99af-495e-9876-926d6aeb0d82 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "POST /compute/v2.1/servers/7122531d-d371-4c4c-8d9f-fc74be8649c1/action" status: 202 len: 0 microversion: 2.1 time: 0.143429 Aug 27 02:22:44.645332 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 138/276] 10.222.0.61 () {60 vars in 1278 bytes} [Sat Aug 27 02:22:44 2022] POST /compute/v2.1/servers/7122531d-d371-4c4c-8d9f-fc74be8649c1/action => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 02:22:44.655855 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-e81fa2ce-8320-42f5-90bf-bc46b7c8da61 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6f819365574091ae344f14e47f487f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa1c411b57d4e72885dac2b4f4dfe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:44.663728 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-e81fa2ce-8320-42f5-90bf-bc46b7c8da61 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/d5c72277-dabd-484c-9e20-279b6159516a" status: 200 len: 1299 microversion: 2.1 time: 0.112039 Aug 27 02:22:44.664593 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 139/277] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:22:44 2022] GET /compute/v2.1/servers/d5c72277-dabd-484c-9e20-279b6159516a => generated 1299 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:22:44.677358 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-c5448b1a-8e05-47b7-a557-956c2cfd2789 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:44.679232 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-c5448b1a-8e05-47b7-a557-956c2cfd2789 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 7122531d-d371-4c4c-8d9f-fc74be8649c1] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:44.688480 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c5448b1a-8e05-47b7-a557-956c2cfd2789 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:44.688972 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c5448b1a-8e05-47b7-a557-956c2cfd2789 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:44.689423 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c5448b1a-8e05-47b7-a557-956c2cfd2789 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:44.690213 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c5448b1a-8e05-47b7-a557-956c2cfd2789 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:44.690670 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c5448b1a-8e05-47b7-a557-956c2cfd2789 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:44.691123 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c5448b1a-8e05-47b7-a557-956c2cfd2789 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:45.202233 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-c5448b1a-8e05-47b7-a557-956c2cfd2789 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:45.213325 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-c5448b1a-8e05-47b7-a557-956c2cfd2789 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/7122531d-d371-4c4c-8d9f-fc74be8649c1" status: 200 len: 1510 microversion: 2.1 time: 0.552358 Aug 27 02:22:45.214268 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 139/278] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:22:44 2022] GET /compute/v2.1/servers/7122531d-d371-4c4c-8d9f-fc74be8649c1 => generated 1510 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:22:45.544415 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-ed470b1a-8d56-4dd7-988b-4c241e26f01e tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:45.545202 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-ed470b1a-8d56-4dd7-988b-4c241e26f01e tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:45.556357 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ed470b1a-8d56-4dd7-988b-4c241e26f01e tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:45.556846 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ed470b1a-8d56-4dd7-988b-4c241e26f01e tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:45.557296 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ed470b1a-8d56-4dd7-988b-4c241e26f01e tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:45.558053 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ed470b1a-8d56-4dd7-988b-4c241e26f01e tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:45.558486 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ed470b1a-8d56-4dd7-988b-4c241e26f01e tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:45.574400 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ed470b1a-8d56-4dd7-988b-4c241e26f01e tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:45.692398 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-919a9289-6b09-4cc3-b886-47df61f4e4e6 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:45.692398 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-919a9289-6b09-4cc3-b886-47df61f4e4e6 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: d5c72277-dabd-484c-9e20-279b6159516a] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:45.692398 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=1 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:22:45.699471 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-919a9289-6b09-4cc3-b886-47df61f4e4e6 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:45.704399 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-919a9289-6b09-4cc3-b886-47df61f4e4e6 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:45.705012 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-919a9289-6b09-4cc3-b886-47df61f4e4e6 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:45.708132 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-919a9289-6b09-4cc3-b886-47df61f4e4e6 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:45.708689 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-919a9289-6b09-4cc3-b886-47df61f4e4e6 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:45.709125 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-919a9289-6b09-4cc3-b886-47df61f4e4e6 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:46.099842 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-919a9289-6b09-4cc3-b886-47df61f4e4e6 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6f819365574091ae344f14e47f487f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa1c411b57d4e72885dac2b4f4dfe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:46.125584 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-919a9289-6b09-4cc3-b886-47df61f4e4e6 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/d5c72277-dabd-484c-9e20-279b6159516a" status: 200 len: 1367 microversion: 2.1 time: 0.444735 Aug 27 02:22:46.162401 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 140/279] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:22:45 2022] GET /compute/v2.1/servers/d5c72277-dabd-484c-9e20-279b6159516a => generated 1367 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:22:46.237144 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-ed747d30-93c2-448c-9fa8-a6e0f928d067 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:46.238893 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-ed747d30-93c2-448c-9fa8-a6e0f928d067 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 7122531d-d371-4c4c-8d9f-fc74be8649c1] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:46.248486 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell0:SELECT=4 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:22:46.252337 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ed747d30-93c2-448c-9fa8-a6e0f928d067 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:46.253674 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ed747d30-93c2-448c-9fa8-a6e0f928d067 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:46.254328 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ed747d30-93c2-448c-9fa8-a6e0f928d067 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:46.256128 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ed747d30-93c2-448c-9fa8-a6e0f928d067 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:46.256839 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ed747d30-93c2-448c-9fa8-a6e0f928d067 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:46.257877 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ed747d30-93c2-448c-9fa8-a6e0f928d067 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:46.396236 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-ed470b1a-8d56-4dd7-988b-4c241e26f01e tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:46.404977 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-ed470b1a-8d56-4dd7-988b-4c241e26f01e tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:46.406571 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-ed470b1a-8d56-4dd7-988b-4c241e26f01e tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:46.408045 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-ed470b1a-8d56-4dd7-988b-4c241e26f01e tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db" status: 200 len: 1722 microversion: 2.20 time: 0.871093 Aug 27 02:22:46.408857 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 140/280] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:22:45 2022] GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db => generated 1722 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:22:46.413814 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [req-1d04b669-ea71-4d39-a115-c01455e82998 req-7a3d216c-67be-4f74-bd5d-014ce3aabb0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5c72277-dabd-484c-9e20-279b6159516a", "tag": "e99da92c-3934-4351-8ad6-ffb344f3377f"}]} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:22:46.423563 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-1d04b669-ea71-4d39-a115-c01455e82998 req-7a3d216c-67be-4f74-bd5d-014ce3aabb0d service nova] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:46.424048 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-1d04b669-ea71-4d39-a115-c01455e82998 req-7a3d216c-67be-4f74-bd5d-014ce3aabb0d service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:46.424556 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-1d04b669-ea71-4d39-a115-c01455e82998 req-7a3d216c-67be-4f74-bd5d-014ce3aabb0d service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:46.436119 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.compute.server_external_events [req-1d04b669-ea71-4d39-a115-c01455e82998 req-7a3d216c-67be-4f74-bd5d-014ce3aabb0d service nova] Creating event network-changed:e99da92c-3934-4351-8ad6-ffb344f3377f for instance d5c72277-dabd-484c-9e20-279b6159516a on hv-cinder-84630 Aug 27 02:22:46.441521 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [req-1d04b669-ea71-4d39-a115-c01455e82998 req-7a3d216c-67be-4f74-bd5d-014ce3aabb0d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031503 Aug 27 02:22:46.442287 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 141/281] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Aug 27 02:22:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:22:46.474396 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-ed747d30-93c2-448c-9fa8-a6e0f928d067 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:46.482321 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-ed747d30-93c2-448c-9fa8-a6e0f928d067 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/7122531d-d371-4c4c-8d9f-fc74be8649c1" status: 200 len: 1510 microversion: 2.1 time: 0.249998 Aug 27 02:22:46.482889 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 141/282] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:22:46 2022] GET /compute/v2.1/servers/7122531d-d371-4c4c-8d9f-fc74be8649c1 => generated 1510 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:22:47.173153 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-73da0cf7-b6b9-4d3c-a777-c1f840088fbd tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:47.174186 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-73da0cf7-b6b9-4d3c-a777-c1f840088fbd tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: d5c72277-dabd-484c-9e20-279b6159516a] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:47.185227 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-73da0cf7-b6b9-4d3c-a777-c1f840088fbd tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:47.185848 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-73da0cf7-b6b9-4d3c-a777-c1f840088fbd tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:47.187593 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-73da0cf7-b6b9-4d3c-a777-c1f840088fbd tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:47.188306 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-73da0cf7-b6b9-4d3c-a777-c1f840088fbd tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:47.188753 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-73da0cf7-b6b9-4d3c-a777-c1f840088fbd tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:47.189171 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-73da0cf7-b6b9-4d3c-a777-c1f840088fbd tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:47.433125 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-1521dcbd-44f9-4fc2-9cee-a981c1403b7a tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:47.434001 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-1521dcbd-44f9-4fc2-9cee-a981c1403b7a tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:47.444404 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1521dcbd-44f9-4fc2-9cee-a981c1403b7a tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:47.444877 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1521dcbd-44f9-4fc2-9cee-a981c1403b7a tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:47.445882 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1521dcbd-44f9-4fc2-9cee-a981c1403b7a tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:47.446922 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1521dcbd-44f9-4fc2-9cee-a981c1403b7a tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:47.447429 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1521dcbd-44f9-4fc2-9cee-a981c1403b7a tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:47.448670 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1521dcbd-44f9-4fc2-9cee-a981c1403b7a tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:47.509567 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-73da0cf7-b6b9-4d3c-a777-c1f840088fbd tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6f819365574091ae344f14e47f487f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa1c411b57d4e72885dac2b4f4dfe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:47.525692 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-73da0cf7-b6b9-4d3c-a777-c1f840088fbd tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/d5c72277-dabd-484c-9e20-279b6159516a" status: 200 len: 1367 microversion: 2.1 time: 0.359236 Aug 27 02:22:47.526283 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 142/283] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:22:47 2022] GET /compute/v2.1/servers/d5c72277-dabd-484c-9e20-279b6159516a => generated 1367 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:22:47.553021 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-32e0ab66-4cc2-4304-9435-323a8b47e568 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:47.554802 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-32e0ab66-4cc2-4304-9435-323a8b47e568 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 7122531d-d371-4c4c-8d9f-fc74be8649c1] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:47.574563 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-32e0ab66-4cc2-4304-9435-323a8b47e568 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:47.575804 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-32e0ab66-4cc2-4304-9435-323a8b47e568 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:47.576588 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-32e0ab66-4cc2-4304-9435-323a8b47e568 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:47.577913 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-32e0ab66-4cc2-4304-9435-323a8b47e568 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:47.579420 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-32e0ab66-4cc2-4304-9435-323a8b47e568 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:47.580409 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-32e0ab66-4cc2-4304-9435-323a8b47e568 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:47.677240 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-1521dcbd-44f9-4fc2-9cee-a981c1403b7a tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:47.691125 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-1521dcbd-44f9-4fc2-9cee-a981c1403b7a tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:47.692625 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-1521dcbd-44f9-4fc2-9cee-a981c1403b7a tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:47.694032 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-1521dcbd-44f9-4fc2-9cee-a981c1403b7a tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db" status: 200 len: 1722 microversion: 2.20 time: 0.265519 Aug 27 02:22:47.695000 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 142/284] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:22:47 2022] GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db => generated 1722 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:22:47.917822 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-32e0ab66-4cc2-4304-9435-323a8b47e568 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:47.925974 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-32e0ab66-4cc2-4304-9435-323a8b47e568 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/7122531d-d371-4c4c-8d9f-fc74be8649c1" status: 200 len: 1510 microversion: 2.1 time: 0.394379 Aug 27 02:22:47.926569 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 143/285] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:22:47 2022] GET /compute/v2.1/servers/7122531d-d371-4c4c-8d9f-fc74be8649c1 => generated 1510 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:22:48.274941 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-f8ed6f31-35b0-4677-bfab-5717a39b2932 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2f651749-2cc8-4776-8a0e-32bd390908ba"}} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:22:48.278104 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-f8ed6f31-35b0-4677-bfab-5717a39b2932 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 4fedf0d1-cc1c-4947-b92e-dcb4454889d1] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:48.286915 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f8ed6f31-35b0-4677-bfab-5717a39b2932 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:48.287493 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f8ed6f31-35b0-4677-bfab-5717a39b2932 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:48.288048 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f8ed6f31-35b0-4677-bfab-5717a39b2932 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:48.288823 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f8ed6f31-35b0-4677-bfab-5717a39b2932 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:48.289375 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f8ed6f31-35b0-4677-bfab-5717a39b2932 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:48.290333 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f8ed6f31-35b0-4677-bfab-5717a39b2932 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:48.546766 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-59d16935-53af-4d64-a06c-3766252fe7a9 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:48.548308 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-59d16935-53af-4d64-a06c-3766252fe7a9 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: d5c72277-dabd-484c-9e20-279b6159516a] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:48.562027 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-59d16935-53af-4d64-a06c-3766252fe7a9 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:48.562515 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-59d16935-53af-4d64-a06c-3766252fe7a9 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:48.562963 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-59d16935-53af-4d64-a06c-3766252fe7a9 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:48.563662 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-59d16935-53af-4d64-a06c-3766252fe7a9 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:48.564119 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-59d16935-53af-4d64-a06c-3766252fe7a9 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:48.564544 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-59d16935-53af-4d64-a06c-3766252fe7a9 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:48.732292 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell0:SELECT=2 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:22:48.861064 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-f8ed6f31-35b0-4677-bfab-5717a39b2932 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "POST /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.590600 Aug 27 02:22:48.864676 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 143/286] 10.222.0.61 () {60 vars in 1323 bytes} [Sat Aug 27 02:22:48 2022] POST /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1/os-volume_attachments => generated 194 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:22:48.880376 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-bd414472-d8d9-40da-ba34-9cd0cf04ba3a tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:48.881572 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-bd414472-d8d9-40da-ba34-9cd0cf04ba3a tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:48.904898 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bd414472-d8d9-40da-ba34-9cd0cf04ba3a tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:48.912456 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bd414472-d8d9-40da-ba34-9cd0cf04ba3a tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:48.913030 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bd414472-d8d9-40da-ba34-9cd0cf04ba3a tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:48.913821 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bd414472-d8d9-40da-ba34-9cd0cf04ba3a tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:48.914293 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bd414472-d8d9-40da-ba34-9cd0cf04ba3a tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:48.914719 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bd414472-d8d9-40da-ba34-9cd0cf04ba3a tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:49.004863 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell0:SELECT=8 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:22:49.211480 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-59d16935-53af-4d64-a06c-3766252fe7a9 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6f819365574091ae344f14e47f487f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa1c411b57d4e72885dac2b4f4dfe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:49.238473 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-59d16935-53af-4d64-a06c-3766252fe7a9 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/d5c72277-dabd-484c-9e20-279b6159516a" status: 200 len: 1367 microversion: 2.1 time: 0.695798 Aug 27 02:22:49.239502 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 144/287] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:22:48 2022] GET /compute/v2.1/servers/d5c72277-dabd-484c-9e20-279b6159516a => generated 1367 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:22:49.260259 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-2d43bda3-1e22-46ef-9b87-24194c78b84b tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:49.261379 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-2d43bda3-1e22-46ef-9b87-24194c78b84b tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 7122531d-d371-4c4c-8d9f-fc74be8649c1] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:49.273982 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2d43bda3-1e22-46ef-9b87-24194c78b84b tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:49.275196 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2d43bda3-1e22-46ef-9b87-24194c78b84b tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:49.276237 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2d43bda3-1e22-46ef-9b87-24194c78b84b tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:49.277837 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2d43bda3-1e22-46ef-9b87-24194c78b84b tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:49.278902 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2d43bda3-1e22-46ef-9b87-24194c78b84b tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:49.279887 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2d43bda3-1e22-46ef-9b87-24194c78b84b tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:49.319002 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-bd414472-d8d9-40da-ba34-9cd0cf04ba3a tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:49.335172 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-bd414472-d8d9-40da-ba34-9cd0cf04ba3a tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:49.336664 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-bd414472-d8d9-40da-ba34-9cd0cf04ba3a tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:49.338163 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-bd414472-d8d9-40da-ba34-9cd0cf04ba3a tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db" status: 200 len: 1722 microversion: 2.20 time: 0.470678 Aug 27 02:22:49.338867 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 144/288] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:22:48 2022] GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db => generated 1722 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:22:49.804474 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-2d43bda3-1e22-46ef-9b87-24194c78b84b tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:49.813891 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-2d43bda3-1e22-46ef-9b87-24194c78b84b tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/7122531d-d371-4c4c-8d9f-fc74be8649c1" status: 200 len: 1516 microversion: 2.1 time: 0.572705 Aug 27 02:22:49.815672 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 145/289] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:22:49 2022] GET /compute/v2.1/servers/7122531d-d371-4c4c-8d9f-fc74be8649c1 => generated 1516 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:22:50.264266 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-e79a29fd-ed17-4faa-b18f-8e80c3bb6cd3 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:50.266270 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-e79a29fd-ed17-4faa-b18f-8e80c3bb6cd3 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: d5c72277-dabd-484c-9e20-279b6159516a] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:50.289582 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e79a29fd-ed17-4faa-b18f-8e80c3bb6cd3 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:50.292749 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e79a29fd-ed17-4faa-b18f-8e80c3bb6cd3 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:50.293463 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e79a29fd-ed17-4faa-b18f-8e80c3bb6cd3 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:50.295191 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e79a29fd-ed17-4faa-b18f-8e80c3bb6cd3 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:50.296848 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e79a29fd-ed17-4faa-b18f-8e80c3bb6cd3 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:50.297530 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e79a29fd-ed17-4faa-b18f-8e80c3bb6cd3 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:50.376097 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-5067fdaf-a7ee-4f43-bef8-c2cfca579437 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:50.376703 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-5067fdaf-a7ee-4f43-bef8-c2cfca579437 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:50.395314 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5067fdaf-a7ee-4f43-bef8-c2cfca579437 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:50.395818 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5067fdaf-a7ee-4f43-bef8-c2cfca579437 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:50.396253 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5067fdaf-a7ee-4f43-bef8-c2cfca579437 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:50.396982 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5067fdaf-a7ee-4f43-bef8-c2cfca579437 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:50.397438 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5067fdaf-a7ee-4f43-bef8-c2cfca579437 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:50.398045 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5067fdaf-a7ee-4f43-bef8-c2cfca579437 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:50.636615 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-e79a29fd-ed17-4faa-b18f-8e80c3bb6cd3 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6f819365574091ae344f14e47f487f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa1c411b57d4e72885dac2b4f4dfe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:50.647900 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-e79a29fd-ed17-4faa-b18f-8e80c3bb6cd3 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/d5c72277-dabd-484c-9e20-279b6159516a" status: 200 len: 1367 microversion: 2.1 time: 0.391121 Aug 27 02:22:50.651991 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 145/290] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:22:50 2022] GET /compute/v2.1/servers/d5c72277-dabd-484c-9e20-279b6159516a => generated 1367 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:22:50.885033 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-5067fdaf-a7ee-4f43-bef8-c2cfca579437 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:50.897245 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-5067fdaf-a7ee-4f43-bef8-c2cfca579437 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:50.904529 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-5067fdaf-a7ee-4f43-bef8-c2cfca579437 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:50.906476 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-5067fdaf-a7ee-4f43-bef8-c2cfca579437 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db" status: 200 len: 1722 microversion: 2.20 time: 0.534114 Aug 27 02:22:50.907644 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 146/291] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:22:50 2022] GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db => generated 1722 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:22:51.525922 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-32873534-76f2-4652-855a-f0660ec6199f tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Action: 'create', calling method: .version_select at 0x7fd8085d8820>, body: {"keypair": {"name": "tempest-keypair-1982819205", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIDUhpebYL/pjy2knVInFdTBE1ZOvjVPzQ3awM5L5niV850zOax3l25Jmb2HEM8/4+lgShiLkFFupnVtpgWkaEGlIYN50bgng7+tMUa5MTV8GOA9YaWMvth/3LZsXl6thg=="}} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:22:51.550750 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.quota [None req-32873534-76f2-4652-855a-f0660ec6199f tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Getting quotas for project 67209b74f2fa4ae7ad9762d141378a5d. Resources: {'key_pairs'} {{(pid=120783) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:22:51.556892 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.quota [None req-32873534-76f2-4652-855a-f0660ec6199f tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Getting quotas for user 1eb664209056410d890d1b2b8bfa0155 and project 67209b74f2fa4ae7ad9762d141378a5d. Resources: {'key_pairs'} {{(pid=120783) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:22:51.588246 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-32873534-76f2-4652-855a-f0660ec6199f tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.067182 Aug 27 02:22:51.589043 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 146/292] 10.222.0.61 () {60 vars in 1159 bytes} [Sat Aug 27 02:22:51 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:22:51.674506 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-e4688f03-b5a4-4527-87eb-bf16f9892a9d tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:51.676578 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-e4688f03-b5a4-4527-87eb-bf16f9892a9d tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: d5c72277-dabd-484c-9e20-279b6159516a] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:51.699912 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e4688f03-b5a4-4527-87eb-bf16f9892a9d tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:51.704186 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e4688f03-b5a4-4527-87eb-bf16f9892a9d tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:51.705061 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e4688f03-b5a4-4527-87eb-bf16f9892a9d tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:51.706275 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e4688f03-b5a4-4527-87eb-bf16f9892a9d tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:51.710536 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e4688f03-b5a4-4527-87eb-bf16f9892a9d tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:51.712885 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e4688f03-b5a4-4527-87eb-bf16f9892a9d tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:51.934375 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-71d64e4e-e1b5-40b6-857c-122d7a2031db tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:51.935199 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-71d64e4e-e1b5-40b6-857c-122d7a2031db tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:51.943045 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-71d64e4e-e1b5-40b6-857c-122d7a2031db tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:51.943914 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-71d64e4e-e1b5-40b6-857c-122d7a2031db tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:51.944491 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-71d64e4e-e1b5-40b6-857c-122d7a2031db tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:51.945352 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-71d64e4e-e1b5-40b6-857c-122d7a2031db tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:51.945976 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-71d64e4e-e1b5-40b6-857c-122d7a2031db tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:51.946539 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-71d64e4e-e1b5-40b6-857c-122d7a2031db tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:52.377207 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-e4688f03-b5a4-4527-87eb-bf16f9892a9d tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6f819365574091ae344f14e47f487f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa1c411b57d4e72885dac2b4f4dfe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:52.411006 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-e4688f03-b5a4-4527-87eb-bf16f9892a9d tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/d5c72277-dabd-484c-9e20-279b6159516a" status: 200 len: 1367 microversion: 2.1 time: 0.742938 Aug 27 02:22:52.411786 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 147/293] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:22:51 2022] GET /compute/v2.1/servers/d5c72277-dabd-484c-9e20-279b6159516a => generated 1367 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:22:52.485937 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-73a96515-30de-4463-a18b-85851a990b90 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:22:52.494440 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-73a96515-30de-4463-a18b-85851a990b90 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:52.495175 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-73a96515-30de-4463-a18b-85851a990b90 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:52.495952 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-73a96515-30de-4463-a18b-85851a990b90 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:52.580227 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-71d64e4e-e1b5-40b6-857c-122d7a2031db tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:52.599591 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-71d64e4e-e1b5-40b6-857c-122d7a2031db tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:52.601031 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-71d64e4e-e1b5-40b6-857c-122d7a2031db tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:52.608527 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-71d64e4e-e1b5-40b6-857c-122d7a2031db tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db" status: 200 len: 1722 microversion: 2.20 time: 0.678666 Aug 27 02:22:52.611797 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 147/294] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:22:51 2022] GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db => generated 1722 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:22:52.620328 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-73a96515-30de-4463-a18b-85851a990b90 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 4fedf0d1-cc1c-4947-b92e-dcb4454889d1] Going to try to stop instance {{(pid=120782) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 27 02:22:52.741576 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-73a96515-30de-4463-a18b-85851a990b90 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "POST /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1/action" status: 202 len: 0 microversion: 2.1 time: 0.261527 Aug 27 02:22:52.742788 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 148/295] 10.222.0.61 () {60 vars in 1278 bytes} [Sat Aug 27 02:22:52 2022] POST /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1/action => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 02:22:52.753062 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-b25e4e8a-c5a0-4677-8d69-a5e063c20d3f tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:52.754459 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-b25e4e8a-c5a0-4677-8d69-a5e063c20d3f tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 4fedf0d1-cc1c-4947-b92e-dcb4454889d1] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:52.763998 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b25e4e8a-c5a0-4677-8d69-a5e063c20d3f tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:52.764866 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b25e4e8a-c5a0-4677-8d69-a5e063c20d3f tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:52.765313 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b25e4e8a-c5a0-4677-8d69-a5e063c20d3f tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:52.766417 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b25e4e8a-c5a0-4677-8d69-a5e063c20d3f tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:52.769761 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b25e4e8a-c5a0-4677-8d69-a5e063c20d3f tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:52.770358 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b25e4e8a-c5a0-4677-8d69-a5e063c20d3f tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:53.022118 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-b25e4e8a-c5a0-4677-8d69-a5e063c20d3f tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fbea2c71674b239e6d8fba6518e962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d9d02db5c49fda33321f2914a7f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:53.040720 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-b25e4e8a-c5a0-4677-8d69-a5e063c20d3f tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1" status: 200 len: 1720 microversion: 2.1 time: 0.293913 Aug 27 02:22:53.041959 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 148/296] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:22:52 2022] GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1 => generated 1720 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:22:53.433862 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-7c0e9209-dded-4303-ae7c-ba72945be47e tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:53.434584 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-7c0e9209-dded-4303-ae7c-ba72945be47e tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: d5c72277-dabd-484c-9e20-279b6159516a] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:53.453527 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7c0e9209-dded-4303-ae7c-ba72945be47e tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:53.454291 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7c0e9209-dded-4303-ae7c-ba72945be47e tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:53.454874 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7c0e9209-dded-4303-ae7c-ba72945be47e tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:53.455777 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7c0e9209-dded-4303-ae7c-ba72945be47e tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:53.456397 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7c0e9209-dded-4303-ae7c-ba72945be47e tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:53.456821 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7c0e9209-dded-4303-ae7c-ba72945be47e tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:53.636540 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-998c40eb-2e1f-457d-a5ac-9f01c9b81dfe tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:53.637155 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-998c40eb-2e1f-457d-a5ac-9f01c9b81dfe tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:53.656092 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-998c40eb-2e1f-457d-a5ac-9f01c9b81dfe tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:53.656852 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-998c40eb-2e1f-457d-a5ac-9f01c9b81dfe tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:53.657483 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-998c40eb-2e1f-457d-a5ac-9f01c9b81dfe tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:53.658377 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-998c40eb-2e1f-457d-a5ac-9f01c9b81dfe tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:53.658987 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-998c40eb-2e1f-457d-a5ac-9f01c9b81dfe tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:53.659565 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-998c40eb-2e1f-457d-a5ac-9f01c9b81dfe tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:53.765924 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-7c0e9209-dded-4303-ae7c-ba72945be47e tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6f819365574091ae344f14e47f487f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa1c411b57d4e72885dac2b4f4dfe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:53.776517 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-7c0e9209-dded-4303-ae7c-ba72945be47e tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/d5c72277-dabd-484c-9e20-279b6159516a" status: 200 len: 1367 microversion: 2.1 time: 0.347785 Aug 27 02:22:53.777904 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 149/297] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:22:53 2022] GET /compute/v2.1/servers/d5c72277-dabd-484c-9e20-279b6159516a => generated 1367 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:22:54.065498 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-5be51b44-57af-4c36-88d2-70737637501d tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:54.066353 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-5be51b44-57af-4c36-88d2-70737637501d tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 4fedf0d1-cc1c-4947-b92e-dcb4454889d1] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:54.077642 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5be51b44-57af-4c36-88d2-70737637501d tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:54.088657 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5be51b44-57af-4c36-88d2-70737637501d tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:54.089363 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5be51b44-57af-4c36-88d2-70737637501d tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:54.090335 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5be51b44-57af-4c36-88d2-70737637501d tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:54.091062 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5be51b44-57af-4c36-88d2-70737637501d tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:54.093693 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5be51b44-57af-4c36-88d2-70737637501d tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:54.267355 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-998c40eb-2e1f-457d-a5ac-9f01c9b81dfe tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:54.271307 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:22:54.288549 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-998c40eb-2e1f-457d-a5ac-9f01c9b81dfe tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:54.290651 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-998c40eb-2e1f-457d-a5ac-9f01c9b81dfe tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:54.292175 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-998c40eb-2e1f-457d-a5ac-9f01c9b81dfe tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db" status: 200 len: 1722 microversion: 2.20 time: 0.659581 Aug 27 02:22:54.293099 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 149/298] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:22:53 2022] GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db => generated 1722 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:22:54.577764 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-5be51b44-57af-4c36-88d2-70737637501d tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fbea2c71674b239e6d8fba6518e962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d9d02db5c49fda33321f2914a7f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:54.586410 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-5be51b44-57af-4c36-88d2-70737637501d tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1" status: 200 len: 1720 microversion: 2.1 time: 0.527118 Aug 27 02:22:54.600666 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 150/299] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:22:54 2022] GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1 => generated 1720 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:22:54.815651 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-8374e3b2-6f1c-48b4-8f6a-29e54423d967 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:54.819102 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-8374e3b2-6f1c-48b4-8f6a-29e54423d967 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: d5c72277-dabd-484c-9e20-279b6159516a] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:54.848176 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8374e3b2-6f1c-48b4-8f6a-29e54423d967 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:54.850609 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8374e3b2-6f1c-48b4-8f6a-29e54423d967 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:54.851298 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8374e3b2-6f1c-48b4-8f6a-29e54423d967 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:54.854251 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8374e3b2-6f1c-48b4-8f6a-29e54423d967 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:54.871357 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8374e3b2-6f1c-48b4-8f6a-29e54423d967 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:54.873234 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8374e3b2-6f1c-48b4-8f6a-29e54423d967 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:55.180975 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-8374e3b2-6f1c-48b4-8f6a-29e54423d967 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6f819365574091ae344f14e47f487f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa1c411b57d4e72885dac2b4f4dfe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:55.193751 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-8374e3b2-6f1c-48b4-8f6a-29e54423d967 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/d5c72277-dabd-484c-9e20-279b6159516a" status: 200 len: 1367 microversion: 2.1 time: 0.396183 Aug 27 02:22:55.195136 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 150/300] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:22:54 2022] GET /compute/v2.1/servers/d5c72277-dabd-484c-9e20-279b6159516a => generated 1367 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:22:55.320466 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-f3ed07e6-24df-4876-82d5-dab3e911b4db tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:55.321072 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-f3ed07e6-24df-4876-82d5-dab3e911b4db tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:55.350138 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f3ed07e6-24df-4876-82d5-dab3e911b4db tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:55.350637 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f3ed07e6-24df-4876-82d5-dab3e911b4db tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:55.351089 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f3ed07e6-24df-4876-82d5-dab3e911b4db tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:55.352012 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f3ed07e6-24df-4876-82d5-dab3e911b4db tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:55.353376 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f3ed07e6-24df-4876-82d5-dab3e911b4db tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:55.353885 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f3ed07e6-24df-4876-82d5-dab3e911b4db tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:55.608791 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-2b21e00b-2981-43ff-b423-6c63f7d07da9 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:55.610802 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-2b21e00b-2981-43ff-b423-6c63f7d07da9 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 4fedf0d1-cc1c-4947-b92e-dcb4454889d1] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:55.622432 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2b21e00b-2981-43ff-b423-6c63f7d07da9 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:55.623106 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2b21e00b-2981-43ff-b423-6c63f7d07da9 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:55.623632 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2b21e00b-2981-43ff-b423-6c63f7d07da9 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:55.624767 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2b21e00b-2981-43ff-b423-6c63f7d07da9 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:55.628312 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2b21e00b-2981-43ff-b423-6c63f7d07da9 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:55.628912 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2b21e00b-2981-43ff-b423-6c63f7d07da9 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:55.644054 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-f3ed07e6-24df-4876-82d5-dab3e911b4db tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:55.654823 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-f3ed07e6-24df-4876-82d5-dab3e911b4db tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:55.658036 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-f3ed07e6-24df-4876-82d5-dab3e911b4db tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:55.660607 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-f3ed07e6-24df-4876-82d5-dab3e911b4db tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db" status: 200 len: 1722 microversion: 2.20 time: 0.343289 Aug 27 02:22:55.677545 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 151/301] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:22:55 2022] GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db => generated 1722 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:22:55.984289 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-2b21e00b-2981-43ff-b423-6c63f7d07da9 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fbea2c71674b239e6d8fba6518e962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d9d02db5c49fda33321f2914a7f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:56.002152 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-2b21e00b-2981-43ff-b423-6c63f7d07da9 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1" status: 200 len: 1720 microversion: 2.1 time: 0.397634 Aug 27 02:22:56.006121 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 151/302] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:22:55 2022] GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1 => generated 1720 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:22:56.218698 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-1fb90b5f-eaae-42d8-a76f-f94be918a189 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:56.219480 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-1fb90b5f-eaae-42d8-a76f-f94be918a189 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: d5c72277-dabd-484c-9e20-279b6159516a] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:56.236877 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1fb90b5f-eaae-42d8-a76f-f94be918a189 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:56.238981 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1fb90b5f-eaae-42d8-a76f-f94be918a189 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:56.240434 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1fb90b5f-eaae-42d8-a76f-f94be918a189 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:56.241511 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1fb90b5f-eaae-42d8-a76f-f94be918a189 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:56.244908 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1fb90b5f-eaae-42d8-a76f-f94be918a189 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:56.245764 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1fb90b5f-eaae-42d8-a76f-f94be918a189 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:56.603717 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-1fb90b5f-eaae-42d8-a76f-f94be918a189 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6f819365574091ae344f14e47f487f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa1c411b57d4e72885dac2b4f4dfe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:56.612887 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-1fb90b5f-eaae-42d8-a76f-f94be918a189 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/d5c72277-dabd-484c-9e20-279b6159516a" status: 200 len: 1367 microversion: 2.1 time: 0.401635 Aug 27 02:22:56.614137 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 152/303] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:22:56 2022] GET /compute/v2.1/servers/d5c72277-dabd-484c-9e20-279b6159516a => generated 1367 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:22:56.689317 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-2055f0f4-990a-4b35-925e-c6151aa6902d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:56.690188 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-2055f0f4-990a-4b35-925e-c6151aa6902d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:56.698316 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2055f0f4-990a-4b35-925e-c6151aa6902d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:56.699148 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2055f0f4-990a-4b35-925e-c6151aa6902d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:56.699843 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2055f0f4-990a-4b35-925e-c6151aa6902d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:56.700704 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2055f0f4-990a-4b35-925e-c6151aa6902d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:56.701297 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2055f0f4-990a-4b35-925e-c6151aa6902d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:56.701896 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2055f0f4-990a-4b35-925e-c6151aa6902d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:57.023618 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-74539148-2050-45d5-a47a-0775cca9fef2 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:57.024277 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-74539148-2050-45d5-a47a-0775cca9fef2 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 4fedf0d1-cc1c-4947-b92e-dcb4454889d1] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:57.037740 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-74539148-2050-45d5-a47a-0775cca9fef2 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:57.038246 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-74539148-2050-45d5-a47a-0775cca9fef2 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:57.038685 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-74539148-2050-45d5-a47a-0775cca9fef2 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:57.039397 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-74539148-2050-45d5-a47a-0775cca9fef2 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:57.039942 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-74539148-2050-45d5-a47a-0775cca9fef2 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:57.040667 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-74539148-2050-45d5-a47a-0775cca9fef2 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:57.153279 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-2055f0f4-990a-4b35-925e-c6151aa6902d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:57.163246 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-2055f0f4-990a-4b35-925e-c6151aa6902d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:57.167330 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-2055f0f4-990a-4b35-925e-c6151aa6902d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:57.168983 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-2055f0f4-990a-4b35-925e-c6151aa6902d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db" status: 200 len: 1722 microversion: 2.20 time: 0.488223 Aug 27 02:22:57.170056 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 152/304] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:22:56 2022] GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db => generated 1722 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:22:57.355967 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-7940bf29-689e-4223-bb85-7c45f9606361 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-452233683", "imageRef": "7d45cdd6-750f-40c7-9475-f7bf12fcb204", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "82c98610-ea02-4053-b24b-05eb88fd6050"}], "security_groups": [{"name": "tempest-securitygroup--1042022206"}], "key_name": "tempest-keypair-1982819205", "user_data": "}} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:22:57.615997 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-74539148-2050-45d5-a47a-0775cca9fef2 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fbea2c71674b239e6d8fba6518e962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d9d02db5c49fda33321f2914a7f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:57.627910 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-74539148-2050-45d5-a47a-0775cca9fef2 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1" status: 200 len: 1720 microversion: 2.1 time: 0.608090 Aug 27 02:22:57.631433 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 153/305] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:22:57 2022] GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1 => generated 1720 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:22:57.655767 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-a8798a2c-f0f4-41f5-b9a0-d44622a0a643 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:57.658274 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.network.neutron [None req-7940bf29-689e-4223-bb85-7c45f9606361 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] validate_networks() for [('82c98610-ea02-4053-b24b-05eb88fd6050', None, None, None, None, None)] {{(pid=120783) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:22:57.659543 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-a8798a2c-f0f4-41f5-b9a0-d44622a0a643 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: d5c72277-dabd-484c-9e20-279b6159516a] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:57.680888 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a8798a2c-f0f4-41f5-b9a0-d44622a0a643 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:57.681541 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a8798a2c-f0f4-41f5-b9a0-d44622a0a643 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:57.682004 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a8798a2c-f0f4-41f5-b9a0-d44622a0a643 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:57.682869 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a8798a2c-f0f4-41f5-b9a0-d44622a0a643 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:57.683368 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a8798a2c-f0f4-41f5-b9a0-d44622a0a643 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:57.683790 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a8798a2c-f0f4-41f5-b9a0-d44622a0a643 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:58.173592 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-a8798a2c-f0f4-41f5-b9a0-d44622a0a643 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6f819365574091ae344f14e47f487f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa1c411b57d4e72885dac2b4f4dfe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:58.189811 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-a8798a2c-f0f4-41f5-b9a0-d44622a0a643 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/d5c72277-dabd-484c-9e20-279b6159516a" status: 200 len: 1367 microversion: 2.1 time: 0.549022 Aug 27 02:22:58.192822 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 154/306] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:22:57 2022] GET /compute/v2.1/servers/d5c72277-dabd-484c-9e20-279b6159516a => generated 1367 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:22:58.211205 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [req-fb367737-2777-4f47-99ae-d34a4fb70ed9 req-156c56ca-6b26-49ce-9f94-0a88d9739555 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5c72277-dabd-484c-9e20-279b6159516a", "name": "network-vif-plugged", "status": "completed", "tag": "e99da92c-3934-4351-8ad6-ffb344f3377f"}]} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:22:58.232006 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-fb367737-2777-4f47-99ae-d34a4fb70ed9 req-156c56ca-6b26-49ce-9f94-0a88d9739555 service nova] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:58.232499 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-fb367737-2777-4f47-99ae-d34a4fb70ed9 req-156c56ca-6b26-49ce-9f94-0a88d9739555 service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:58.235678 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-fb367737-2777-4f47-99ae-d34a4fb70ed9 req-156c56ca-6b26-49ce-9f94-0a88d9739555 service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:58.266396 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.compute.server_external_events [req-fb367737-2777-4f47-99ae-d34a4fb70ed9 req-156c56ca-6b26-49ce-9f94-0a88d9739555 service nova] Creating event network-vif-plugged:e99da92c-3934-4351-8ad6-ffb344f3377f for instance d5c72277-dabd-484c-9e20-279b6159516a on hv-cinder-84630 Aug 27 02:22:58.278747 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [req-fb367737-2777-4f47-99ae-d34a4fb70ed9 req-156c56ca-6b26-49ce-9f94-0a88d9739555 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083380 Aug 27 02:22:58.279446 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 155/307] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Aug 27 02:22:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:22:58.299678 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-353dcf18-d192-4cd4-ab74-95c353ca39f8 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:58.300925 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-353dcf18-d192-4cd4-ab74-95c353ca39f8 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:58.335463 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-353dcf18-d192-4cd4-ab74-95c353ca39f8 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:58.337054 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-353dcf18-d192-4cd4-ab74-95c353ca39f8 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:58.338683 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-353dcf18-d192-4cd4-ab74-95c353ca39f8 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:58.339968 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-353dcf18-d192-4cd4-ab74-95c353ca39f8 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:58.343460 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-353dcf18-d192-4cd4-ab74-95c353ca39f8 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:58.346748 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-353dcf18-d192-4cd4-ab74-95c353ca39f8 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:58.361745 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:22:59.188060 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.virt.hardware [None req-7940bf29-689e-4223-bb85-7c45f9606361 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Flavor limits 0:0:0 {{(pid=120783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:22:59.189128 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.virt.hardware [None req-7940bf29-689e-4223-bb85-7c45f9606361 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Image limits 0:0:0 {{(pid=120783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:22:59.189643 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.virt.hardware [None req-7940bf29-689e-4223-bb85-7c45f9606361 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Flavor pref 0:0:0 {{(pid=120783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:22:59.190202 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.virt.hardware [None req-7940bf29-689e-4223-bb85-7c45f9606361 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Image pref 0:0:0 {{(pid=120783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:22:59.190769 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.virt.hardware [None req-7940bf29-689e-4223-bb85-7c45f9606361 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:22:59.216210 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7940bf29-689e-4223-bb85-7c45f9606361 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:59.216942 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7940bf29-689e-4223-bb85-7c45f9606361 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:59.227847 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7940bf29-689e-4223-bb85-7c45f9606361 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:59.229164 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7940bf29-689e-4223-bb85-7c45f9606361 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:59.231123 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7940bf29-689e-4223-bb85-7c45f9606361 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:59.232510 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7940bf29-689e-4223-bb85-7c45f9606361 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:59.285615 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.quota [None req-7940bf29-689e-4223-bb85-7c45f9606361 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Getting quotas for project 67209b74f2fa4ae7ad9762d141378a5d. Resources: {'instances', 'ram', 'cores'} {{(pid=120783) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:22:59.291763 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.quota [None req-7940bf29-689e-4223-bb85-7c45f9606361 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Getting quotas for user 1eb664209056410d890d1b2b8bfa0155 and project 67209b74f2fa4ae7ad9762d141378a5d. Resources: {'instances', 'ram', 'cores'} {{(pid=120783) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:22:59.319041 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-7940bf29-689e-4223-bb85-7c45f9606361 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Going to run 1 instances... {{(pid=120783) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:22:59.328369 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-7940bf29-689e-4223-bb85-7c45f9606361 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 1b9390be-aab0-4240-83d9-0f815f094605] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7d45cdd6-750f-40c7-9475-f7bf12fcb204',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120783) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:22:59.335853 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-353dcf18-d192-4cd4-ab74-95c353ca39f8 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:59.353121 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-353dcf18-d192-4cd4-ab74-95c353ca39f8 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:59.354922 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-353dcf18-d192-4cd4-ab74-95c353ca39f8 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:59.362174 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-353dcf18-d192-4cd4-ab74-95c353ca39f8 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db" status: 200 len: 1722 microversion: 2.20 time: 1.079426 Aug 27 02:22:59.370442 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 156/308] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:22:58 2022] GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db => generated 1722 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:22:59.379524 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-f0290eef-9c85-474c-960a-c5f11ca876a3 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:59.388728 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-f0290eef-9c85-474c-960a-c5f11ca876a3 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 4fedf0d1-cc1c-4947-b92e-dcb4454889d1] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:59.414861 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f0290eef-9c85-474c-960a-c5f11ca876a3 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:59.415361 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f0290eef-9c85-474c-960a-c5f11ca876a3 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:59.415804 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f0290eef-9c85-474c-960a-c5f11ca876a3 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:59.427656 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f0290eef-9c85-474c-960a-c5f11ca876a3 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:59.428240 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f0290eef-9c85-474c-960a-c5f11ca876a3 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:59.428744 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f0290eef-9c85-474c-960a-c5f11ca876a3 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:59.502082 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-7940bf29-689e-4223-bb85-7c45f9606361 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.150329 Aug 27 02:22:59.515985 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 153/309] 10.222.0.61 () {60 vars in 1147 bytes} [Sat Aug 27 02:22:57 2022] POST /compute/v2.1/servers => generated 409 bytes in 2165 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:22:59.537688 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-6904b4f5-93af-4d96-909d-46dff44d350a tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:59.538562 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-6904b4f5-93af-4d96-909d-46dff44d350a tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: d5c72277-dabd-484c-9e20-279b6159516a] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:22:59.563454 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6904b4f5-93af-4d96-909d-46dff44d350a tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:59.563949 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6904b4f5-93af-4d96-909d-46dff44d350a tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:59.564381 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6904b4f5-93af-4d96-909d-46dff44d350a tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:59.565084 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6904b4f5-93af-4d96-909d-46dff44d350a tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:22:59.565566 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6904b4f5-93af-4d96-909d-46dff44d350a tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:22:59.565997 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6904b4f5-93af-4d96-909d-46dff44d350a tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:22:59.934347 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-6904b4f5-93af-4d96-909d-46dff44d350a tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6f819365574091ae344f14e47f487f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa1c411b57d4e72885dac2b4f4dfe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:59.949953 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-6904b4f5-93af-4d96-909d-46dff44d350a tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/d5c72277-dabd-484c-9e20-279b6159516a" status: 200 len: 1367 microversion: 2.1 time: 0.432248 Aug 27 02:22:59.953005 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 154/310] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:22:59 2022] GET /compute/v2.1/servers/d5c72277-dabd-484c-9e20-279b6159516a => generated 1367 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:22:59.953765 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-f0290eef-9c85-474c-960a-c5f11ca876a3 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fbea2c71674b239e6d8fba6518e962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d9d02db5c49fda33321f2914a7f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:22:59.963855 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-f16dc3c1-3007-428b-a7c3-6cd0ca1b61db tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:22:59.964908 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-f0290eef-9c85-474c-960a-c5f11ca876a3 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1" status: 200 len: 1720 microversion: 2.1 time: 0.592815 Aug 27 02:22:59.965691 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 157/311] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:22:59 2022] GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1 => generated 1720 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:22:59.968803 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-f16dc3c1-3007-428b-a7c3-6cd0ca1b61db tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 1b9390be-aab0-4240-83d9-0f815f094605] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:00.091510 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-f16dc3c1-3007-428b-a7c3-6cd0ca1b61db tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:00.103731 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-f16dc3c1-3007-428b-a7c3-6cd0ca1b61db tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605" status: 200 len: 1245 microversion: 2.1 time: 0.146251 Aug 27 02:23:00.105646 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 155/312] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:22:59 2022] GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605 => generated 1245 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:23:00.388277 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-f39b781a-7eb0-40b1-bd9b-8a1c52ff12df tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:00.389666 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-f39b781a-7eb0-40b1-bd9b-8a1c52ff12df tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:00.401359 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f39b781a-7eb0-40b1-bd9b-8a1c52ff12df tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:00.404056 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f39b781a-7eb0-40b1-bd9b-8a1c52ff12df tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:00.404819 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f39b781a-7eb0-40b1-bd9b-8a1c52ff12df tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:00.408582 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f39b781a-7eb0-40b1-bd9b-8a1c52ff12df tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:00.409387 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f39b781a-7eb0-40b1-bd9b-8a1c52ff12df tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:00.411543 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f39b781a-7eb0-40b1-bd9b-8a1c52ff12df tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:00.812170 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-f69ccb55-8036-4aba-a008-471e79c9ffd3 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "20943b60-f684-4f1c-9b51-40515029b2ff", "device": "/dev/sdb"}} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:23:00.829787 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-f69ccb55-8036-4aba-a008-471e79c9ffd3 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] [instance: 35d91cb7-f14b-4788-b503-ea9feaee650b] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:00.880155 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f69ccb55-8036-4aba-a008-471e79c9ffd3 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:00.882592 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f69ccb55-8036-4aba-a008-471e79c9ffd3 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:00.883195 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f69ccb55-8036-4aba-a008-471e79c9ffd3 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:00.884374 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f69ccb55-8036-4aba-a008-471e79c9ffd3 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:00.888830 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f69ccb55-8036-4aba-a008-471e79c9ffd3 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:00.889651 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f69ccb55-8036-4aba-a008-471e79c9ffd3 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:01.088167 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-f39b781a-7eb0-40b1-bd9b-8a1c52ff12df tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:01.099592 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-f39b781a-7eb0-40b1-bd9b-8a1c52ff12df tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:01.101028 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-f39b781a-7eb0-40b1-bd9b-8a1c52ff12df tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:01.107004 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-f39b781a-7eb0-40b1-bd9b-8a1c52ff12df tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db" status: 200 len: 1722 microversion: 2.20 time: 0.723223 Aug 27 02:23:01.107606 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 158/313] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:23:00 2022] GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db => generated 1722 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:23:01.113542 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-d088a4fc-2f6e-410e-9412-2514feb4de30 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:01.120610 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-d088a4fc-2f6e-410e-9412-2514feb4de30 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: d5c72277-dabd-484c-9e20-279b6159516a] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:01.139140 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d088a4fc-2f6e-410e-9412-2514feb4de30 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:01.139995 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d088a4fc-2f6e-410e-9412-2514feb4de30 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:01.140609 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d088a4fc-2f6e-410e-9412-2514feb4de30 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:01.141857 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d088a4fc-2f6e-410e-9412-2514feb4de30 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:01.142489 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d088a4fc-2f6e-410e-9412-2514feb4de30 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:01.143090 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d088a4fc-2f6e-410e-9412-2514feb4de30 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:01.366033 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-d088a4fc-2f6e-410e-9412-2514feb4de30 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6f819365574091ae344f14e47f487f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa1c411b57d4e72885dac2b4f4dfe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:01.376125 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-d088a4fc-2f6e-410e-9412-2514feb4de30 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/d5c72277-dabd-484c-9e20-279b6159516a" status: 200 len: 1558 microversion: 2.1 time: 0.266295 Aug 27 02:23:01.378985 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 159/314] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:23:01 2022] GET /compute/v2.1/servers/d5c72277-dabd-484c-9e20-279b6159516a => generated 1558 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:23:01.386975 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-fce9c79b-60c7-418a-8072-5b6ed8ed935c tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:01.393883 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-fce9c79b-60c7-418a-8072-5b6ed8ed935c tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 4fedf0d1-cc1c-4947-b92e-dcb4454889d1] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:01.416816 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fce9c79b-60c7-418a-8072-5b6ed8ed935c tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:01.417490 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fce9c79b-60c7-418a-8072-5b6ed8ed935c tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:01.417953 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fce9c79b-60c7-418a-8072-5b6ed8ed935c tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:01.418700 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fce9c79b-60c7-418a-8072-5b6ed8ed935c tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:01.419159 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fce9c79b-60c7-418a-8072-5b6ed8ed935c tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:01.419656 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fce9c79b-60c7-418a-8072-5b6ed8ed935c tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:01.764372 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-fce9c79b-60c7-418a-8072-5b6ed8ed935c tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fbea2c71674b239e6d8fba6518e962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d9d02db5c49fda33321f2914a7f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:01.812147 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-fce9c79b-60c7-418a-8072-5b6ed8ed935c tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1" status: 200 len: 1720 microversion: 2.1 time: 0.431081 Aug 27 02:23:01.813897 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 160/315] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:23:01 2022] GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1 => generated 1720 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:23:01.824195 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-ff26b7e9-e49f-4daa-983e-50151e1499c4 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:01.834037 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-ff26b7e9-e49f-4daa-983e-50151e1499c4 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 1b9390be-aab0-4240-83d9-0f815f094605] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:01.857813 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ff26b7e9-e49f-4daa-983e-50151e1499c4 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:01.858517 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ff26b7e9-e49f-4daa-983e-50151e1499c4 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:01.859126 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ff26b7e9-e49f-4daa-983e-50151e1499c4 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:01.860067 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ff26b7e9-e49f-4daa-983e-50151e1499c4 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:01.860706 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ff26b7e9-e49f-4daa-983e-50151e1499c4 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:01.861299 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ff26b7e9-e49f-4daa-983e-50151e1499c4 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:02.072299 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-ff26b7e9-e49f-4daa-983e-50151e1499c4 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:02.088525 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-ff26b7e9-e49f-4daa-983e-50151e1499c4 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605" status: 200 len: 1297 microversion: 2.1 time: 0.269959 Aug 27 02:23:02.092856 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 161/316] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:23:01 2022] GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605 => generated 1297 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:23:02.110902 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-9689227d-cefd-47f5-8c80-32254dd0a7b3 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:02.122115 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-9689227d-cefd-47f5-8c80-32254dd0a7b3 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: d5c72277-dabd-484c-9e20-279b6159516a] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:02.133909 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9689227d-cefd-47f5-8c80-32254dd0a7b3 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:02.135311 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9689227d-cefd-47f5-8c80-32254dd0a7b3 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:02.144510 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9689227d-cefd-47f5-8c80-32254dd0a7b3 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:02.145992 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9689227d-cefd-47f5-8c80-32254dd0a7b3 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:02.146641 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9689227d-cefd-47f5-8c80-32254dd0a7b3 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:02.147451 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9689227d-cefd-47f5-8c80-32254dd0a7b3 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:02.365346 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-9689227d-cefd-47f5-8c80-32254dd0a7b3 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/d5c72277-dabd-484c-9e20-279b6159516a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.270678 Aug 27 02:23:02.366266 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 162/317] 10.222.0.61 () {58 vars in 1275 bytes} [Sat Aug 27 02:23:02 2022] GET /compute/v2.1/servers/d5c72277-dabd-484c-9e20-279b6159516a/os-interface => generated 285 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:23:02.379141 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-e1a1aeb9-cc25-4fac-8f0c-89bca6d749bc tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:02.379767 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-e1a1aeb9-cc25-4fac-8f0c-89bca6d749bc tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:02.390911 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e1a1aeb9-cc25-4fac-8f0c-89bca6d749bc tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:02.393953 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e1a1aeb9-cc25-4fac-8f0c-89bca6d749bc tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:02.394643 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e1a1aeb9-cc25-4fac-8f0c-89bca6d749bc tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:02.395296 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e1a1aeb9-cc25-4fac-8f0c-89bca6d749bc tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:02.395591 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e1a1aeb9-cc25-4fac-8f0c-89bca6d749bc tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:02.396021 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e1a1aeb9-cc25-4fac-8f0c-89bca6d749bc tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:02.752909 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-f69ccb55-8036-4aba-a008-471e79c9ffd3 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] 10.222.0.61 "POST /compute/v2.1/servers/35d91cb7-f14b-4788-b503-ea9feaee650b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.948074 Aug 27 02:23:02.754970 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 156/318] 10.222.0.61 () {60 vars in 1323 bytes} [Sat Aug 27 02:23:00 2022] POST /compute/v2.1/servers/35d91cb7-f14b-4788-b503-ea9feaee650b/os-volume_attachments => generated 194 bytes in 1951 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:23:02.836961 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-30a50f73-1290-41ea-b602-08ed64ac9fe5 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:02.838323 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-30a50f73-1290-41ea-b602-08ed64ac9fe5 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 4fedf0d1-cc1c-4947-b92e-dcb4454889d1] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:02.847881 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-30a50f73-1290-41ea-b602-08ed64ac9fe5 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:02.849980 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-30a50f73-1290-41ea-b602-08ed64ac9fe5 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:02.850544 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-30a50f73-1290-41ea-b602-08ed64ac9fe5 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:02.851696 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-30a50f73-1290-41ea-b602-08ed64ac9fe5 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:02.853321 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-30a50f73-1290-41ea-b602-08ed64ac9fe5 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:02.855271 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-30a50f73-1290-41ea-b602-08ed64ac9fe5 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:03.199605 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-30a50f73-1290-41ea-b602-08ed64ac9fe5 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fbea2c71674b239e6d8fba6518e962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d9d02db5c49fda33321f2914a7f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:03.211650 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-30a50f73-1290-41ea-b602-08ed64ac9fe5 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1" status: 200 len: 1720 microversion: 2.1 time: 0.380648 Aug 27 02:23:03.212932 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 157/319] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:23:02 2022] GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1 => generated 1720 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:23:03.218771 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-fa60d7b0-d66d-4578-b7fe-02e4475bfe6c tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:03.219872 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-fa60d7b0-d66d-4578-b7fe-02e4475bfe6c tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 1b9390be-aab0-4240-83d9-0f815f094605] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:03.229683 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fa60d7b0-d66d-4578-b7fe-02e4475bfe6c tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:03.230818 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fa60d7b0-d66d-4578-b7fe-02e4475bfe6c tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:03.231493 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fa60d7b0-d66d-4578-b7fe-02e4475bfe6c tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:03.237482 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fa60d7b0-d66d-4578-b7fe-02e4475bfe6c tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:03.239020 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fa60d7b0-d66d-4578-b7fe-02e4475bfe6c tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:03.239657 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fa60d7b0-d66d-4578-b7fe-02e4475bfe6c tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:03.352737 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-fa60d7b0-d66d-4578-b7fe-02e4475bfe6c tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:03.366746 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-fa60d7b0-d66d-4578-b7fe-02e4475bfe6c tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605" status: 200 len: 1297 microversion: 2.1 time: 0.152265 Aug 27 02:23:03.369560 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 158/320] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:23:03 2022] GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605 => generated 1297 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:23:04.236470 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-3f4e7995-5a34-4599-9497-710267283634 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:04.237246 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-3f4e7995-5a34-4599-9497-710267283634 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 4fedf0d1-cc1c-4947-b92e-dcb4454889d1] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:04.251750 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3f4e7995-5a34-4599-9497-710267283634 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:04.254600 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3f4e7995-5a34-4599-9497-710267283634 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:04.255223 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3f4e7995-5a34-4599-9497-710267283634 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:04.257983 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3f4e7995-5a34-4599-9497-710267283634 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:04.258703 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3f4e7995-5a34-4599-9497-710267283634 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:04.259686 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3f4e7995-5a34-4599-9497-710267283634 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:04.615028 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-e1a1aeb9-cc25-4fac-8f0c-89bca6d749bc tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:04.625774 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-e1a1aeb9-cc25-4fac-8f0c-89bca6d749bc tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:04.632819 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-e1a1aeb9-cc25-4fac-8f0c-89bca6d749bc tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:04.635541 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-e1a1aeb9-cc25-4fac-8f0c-89bca6d749bc tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db" status: 200 len: 1722 microversion: 2.20 time: 2.268027 Aug 27 02:23:04.638157 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 163/321] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:23:02 2022] GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db => generated 1722 bytes in 2271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:23:04.651600 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-0e5c6617-9adf-4e61-900d-f0ec25e94673 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:04.652375 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-0e5c6617-9adf-4e61-900d-f0ec25e94673 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 1b9390be-aab0-4240-83d9-0f815f094605] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:04.667025 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0e5c6617-9adf-4e61-900d-f0ec25e94673 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:04.670161 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0e5c6617-9adf-4e61-900d-f0ec25e94673 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:04.671339 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0e5c6617-9adf-4e61-900d-f0ec25e94673 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:04.672449 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0e5c6617-9adf-4e61-900d-f0ec25e94673 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:04.674298 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0e5c6617-9adf-4e61-900d-f0ec25e94673 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:04.676534 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0e5c6617-9adf-4e61-900d-f0ec25e94673 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:04.855764 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-3f4e7995-5a34-4599-9497-710267283634 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fbea2c71674b239e6d8fba6518e962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d9d02db5c49fda33321f2914a7f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:04.870250 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-3f4e7995-5a34-4599-9497-710267283634 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1" status: 200 len: 1720 microversion: 2.1 time: 0.638245 Aug 27 02:23:04.873387 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 159/322] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:23:04 2022] GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1 => generated 1720 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:23:05.003783 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-0e5c6617-9adf-4e61-900d-f0ec25e94673 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:05.023939 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-0e5c6617-9adf-4e61-900d-f0ec25e94673 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605" status: 200 len: 1303 microversion: 2.1 time: 0.382013 Aug 27 02:23:05.032843 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 164/323] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:23:04 2022] GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605 => generated 1303 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:23:05.674132 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-2626008e-cc31-4afe-a885-84a13d04ea7a tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:05.674826 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-2626008e-cc31-4afe-a885-84a13d04ea7a tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:05.685344 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2626008e-cc31-4afe-a885-84a13d04ea7a tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:05.689859 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2626008e-cc31-4afe-a885-84a13d04ea7a tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:05.690539 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2626008e-cc31-4afe-a885-84a13d04ea7a tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:05.691386 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2626008e-cc31-4afe-a885-84a13d04ea7a tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:05.692000 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2626008e-cc31-4afe-a885-84a13d04ea7a tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:05.693308 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2626008e-cc31-4afe-a885-84a13d04ea7a tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:05.903015 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-fe7a9036-60be-43ac-b6b3-9f4158eb4678 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:05.903683 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-fe7a9036-60be-43ac-b6b3-9f4158eb4678 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 4fedf0d1-cc1c-4947-b92e-dcb4454889d1] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:05.911582 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fe7a9036-60be-43ac-b6b3-9f4158eb4678 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:05.912296 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fe7a9036-60be-43ac-b6b3-9f4158eb4678 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:05.912973 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fe7a9036-60be-43ac-b6b3-9f4158eb4678 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:05.915313 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fe7a9036-60be-43ac-b6b3-9f4158eb4678 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:05.916143 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fe7a9036-60be-43ac-b6b3-9f4158eb4678 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:05.916824 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fe7a9036-60be-43ac-b6b3-9f4158eb4678 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:06.119045 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-2626008e-cc31-4afe-a885-84a13d04ea7a tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:06.138507 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-2626008e-cc31-4afe-a885-84a13d04ea7a tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:06.140281 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-2626008e-cc31-4afe-a885-84a13d04ea7a tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:06.143448 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-2626008e-cc31-4afe-a885-84a13d04ea7a tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db" status: 200 len: 1743 microversion: 2.20 time: 0.473691 Aug 27 02:23:06.149447 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 160/324] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:23:05 2022] GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db => generated 1743 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:23:06.178673 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-8eb0a882-16a9-4383-be53-adb2ef5107b7 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:06.182789 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-8eb0a882-16a9-4383-be53-adb2ef5107b7 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 1b9390be-aab0-4240-83d9-0f815f094605] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:06.193357 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8eb0a882-16a9-4383-be53-adb2ef5107b7 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:06.194284 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8eb0a882-16a9-4383-be53-adb2ef5107b7 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:06.201278 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8eb0a882-16a9-4383-be53-adb2ef5107b7 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:06.202765 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8eb0a882-16a9-4383-be53-adb2ef5107b7 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:06.203512 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8eb0a882-16a9-4383-be53-adb2ef5107b7 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:06.207134 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8eb0a882-16a9-4383-be53-adb2ef5107b7 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:06.525853 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-8eb0a882-16a9-4383-be53-adb2ef5107b7 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:06.540520 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-8eb0a882-16a9-4383-be53-adb2ef5107b7 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605" status: 200 len: 1303 microversion: 2.1 time: 0.389531 Aug 27 02:23:06.547596 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 161/325] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:23:06 2022] GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605 => generated 1303 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:23:06.649604 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-fe7a9036-60be-43ac-b6b3-9f4158eb4678 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fbea2c71674b239e6d8fba6518e962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d9d02db5c49fda33321f2914a7f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:06.694276 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-fe7a9036-60be-43ac-b6b3-9f4158eb4678 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1" status: 200 len: 1720 microversion: 2.1 time: 0.799707 Aug 27 02:23:06.699426 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 165/326] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:23:05 2022] GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1 => generated 1720 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:23:07.185249 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-8dc4e584-fc58-4d43-a0c1-ca837a82037d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:07.186579 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-8dc4e584-fc58-4d43-a0c1-ca837a82037d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:07.197963 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8dc4e584-fc58-4d43-a0c1-ca837a82037d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:07.198862 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8dc4e584-fc58-4d43-a0c1-ca837a82037d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:07.199509 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8dc4e584-fc58-4d43-a0c1-ca837a82037d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:07.200474 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8dc4e584-fc58-4d43-a0c1-ca837a82037d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:07.201482 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8dc4e584-fc58-4d43-a0c1-ca837a82037d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:07.202706 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8dc4e584-fc58-4d43-a0c1-ca837a82037d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:08.099653 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [req-4e576739-ff98-4a40-b5ed-f4926c896432 req-0c488e00-436f-4001-8c9c-184f7800f968 admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "20943b60-f684-4f1c-9b51-40515029b2ff", "create_info": {"type": "qcow2", "new_file": "volume-20943b60-f684-4f1c-9b51-40515029b2ff.db99e778-90e1-43ce-bb13-d8e1d472ca05.vhdx", "snapshot_id": "db99e778-90e1-43ce-bb13-d8e1d472ca05"}}} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:23:08.103943 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-8dc4e584-fc58-4d43-a0c1-ca837a82037d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:08.128179 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:23:08.133190 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-8dc4e584-fc58-4d43-a0c1-ca837a82037d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:08.142119 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [req-4e576739-ff98-4a40-b5ed-f4926c896432 req-0c488e00-436f-4001-8c9c-184f7800f968 admin admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fd1fc341-d010-4ff9-88d0-44b72da91d5f(cell1) {{(pid=120782) load_cells /opt/stack/nova/nova/compute/api.py:319}} Aug 27 02:23:08.143604 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-4e576739-ff98-4a40-b5ed-f4926c896432 req-0c488e00-436f-4001-8c9c-184f7800f968 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:08.146306 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-4e576739-ff98-4a40-b5ed-f4926c896432 req-0c488e00-436f-4001-8c9c-184f7800f968 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:08.146780 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-8dc4e584-fc58-4d43-a0c1-ca837a82037d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:08.154783 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-4e576739-ff98-4a40-b5ed-f4926c896432 req-0c488e00-436f-4001-8c9c-184f7800f968 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:08.157285 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-8dc4e584-fc58-4d43-a0c1-ca837a82037d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db" status: 200 len: 1743 microversion: 2.20 time: 0.975154 Aug 27 02:23:08.159210 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 162/327] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:23:07 2022] GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db => generated 1743 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:23:08.182796 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-bfb1447f-826c-4fcb-af9d-a4015362f0ab tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:08.185890 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-bfb1447f-826c-4fcb-af9d-a4015362f0ab tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 1b9390be-aab0-4240-83d9-0f815f094605] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:08.210645 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bfb1447f-826c-4fcb-af9d-a4015362f0ab tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:08.211210 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bfb1447f-826c-4fcb-af9d-a4015362f0ab tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:08.215606 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bfb1447f-826c-4fcb-af9d-a4015362f0ab tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:08.216407 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bfb1447f-826c-4fcb-af9d-a4015362f0ab tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:08.216900 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bfb1447f-826c-4fcb-af9d-a4015362f0ab tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:08.222313 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bfb1447f-826c-4fcb-af9d-a4015362f0ab tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:08.316841 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-4e576739-ff98-4a40-b5ed-f4926c896432 req-0c488e00-436f-4001-8c9c-184f7800f968 admin admin] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:08.317342 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-4e576739-ff98-4a40-b5ed-f4926c896432 req-0c488e00-436f-4001-8c9c-184f7800f968 admin admin] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:08.317810 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-4e576739-ff98-4a40-b5ed-f4926c896432 req-0c488e00-436f-4001-8c9c-184f7800f968 admin admin] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:08.407586 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [req-4e576739-ff98-4a40-b5ed-f4926c896432 req-0c488e00-436f-4001-8c9c-184f7800f968 admin admin] 10.222.0.78 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.864182 Aug 27 02:23:08.411261 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 166/328] 10.222.0.78 () {64 vars in 1326 bytes} [Sat Aug 27 02:23:07 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:23:08.433912 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-0f54000c-3f2d-4ad3-9c9f-cbfc887b0c4f tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:08.434680 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-0f54000c-3f2d-4ad3-9c9f-cbfc887b0c4f tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 4fedf0d1-cc1c-4947-b92e-dcb4454889d1] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:08.485683 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0f54000c-3f2d-4ad3-9c9f-cbfc887b0c4f tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:08.490408 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0f54000c-3f2d-4ad3-9c9f-cbfc887b0c4f tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:08.493032 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0f54000c-3f2d-4ad3-9c9f-cbfc887b0c4f tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:08.496117 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0f54000c-3f2d-4ad3-9c9f-cbfc887b0c4f tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:08.496670 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0f54000c-3f2d-4ad3-9c9f-cbfc887b0c4f tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:08.499590 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0f54000c-3f2d-4ad3-9c9f-cbfc887b0c4f tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:09.251921 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell0:SELECT=2 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:23:09.587806 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-bfb1447f-826c-4fcb-af9d-a4015362f0ab tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:09.605239 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-0f54000c-3f2d-4ad3-9c9f-cbfc887b0c4f tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fbea2c71674b239e6d8fba6518e962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d9d02db5c49fda33321f2914a7f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:09.624125 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-0f54000c-3f2d-4ad3-9c9f-cbfc887b0c4f tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1" status: 200 len: 1697 microversion: 2.1 time: 1.204632 Aug 27 02:23:09.624598 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-bfb1447f-826c-4fcb-af9d-a4015362f0ab tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605" status: 200 len: 1371 microversion: 2.1 time: 1.462208 Aug 27 02:23:09.626889 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 163/329] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:23:08 2022] GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605 => generated 1371 bytes in 1467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:23:09.644664 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 167/330] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:23:08 2022] GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1 => generated 1697 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:23:09.646855 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [req-b724a958-afb5-42d3-bbfa-088642191554 req-2a2ca863-fb35-4b3c-b386-a9c7a4f8aa42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5c72277-dabd-484c-9e20-279b6159516a", "tag": "e99da92c-3934-4351-8ad6-ffb344f3377f"}]} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:23:09.661656 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-17893256-045d-4fdf-a0ad-c3e7d45ade03 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:09.665951 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-17893256-045d-4fdf-a0ad-c3e7d45ade03 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:09.689611 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-17893256-045d-4fdf-a0ad-c3e7d45ade03 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:09.698346 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-17893256-045d-4fdf-a0ad-c3e7d45ade03 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:09.701156 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-17893256-045d-4fdf-a0ad-c3e7d45ade03 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:09.702448 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-17893256-045d-4fdf-a0ad-c3e7d45ade03 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:09.703125 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-17893256-045d-4fdf-a0ad-c3e7d45ade03 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:09.704372 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-17893256-045d-4fdf-a0ad-c3e7d45ade03 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:09.719926 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-b724a958-afb5-42d3-bbfa-088642191554 req-2a2ca863-fb35-4b3c-b386-a9c7a4f8aa42 service nova] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:09.721098 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-b724a958-afb5-42d3-bbfa-088642191554 req-2a2ca863-fb35-4b3c-b386-a9c7a4f8aa42 service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:09.723651 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-b724a958-afb5-42d3-bbfa-088642191554 req-2a2ca863-fb35-4b3c-b386-a9c7a4f8aa42 service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:09.801523 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.compute.server_external_events [req-b724a958-afb5-42d3-bbfa-088642191554 req-2a2ca863-fb35-4b3c-b386-a9c7a4f8aa42 service nova] Creating event network-changed:e99da92c-3934-4351-8ad6-ffb344f3377f for instance d5c72277-dabd-484c-9e20-279b6159516a on hv-cinder-84630 Aug 27 02:23:09.824389 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [req-b724a958-afb5-42d3-bbfa-088642191554 req-2a2ca863-fb35-4b3c-b386-a9c7a4f8aa42 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.194957 Aug 27 02:23:09.827130 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 164/331] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Aug 27 02:23:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:23:09.840603 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-5bf1e88a-73fd-4d47-836b-196cee8b1ef1 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:23:09.863040 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5bf1e88a-73fd-4d47-836b-196cee8b1ef1 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:09.866154 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5bf1e88a-73fd-4d47-836b-196cee8b1ef1 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:09.866876 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5bf1e88a-73fd-4d47-836b-196cee8b1ef1 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:10.075038 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-5bf1e88a-73fd-4d47-836b-196cee8b1ef1 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 4fedf0d1-cc1c-4947-b92e-dcb4454889d1] Going to try to start instance {{(pid=120783) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 27 02:23:10.120873 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell0:SELECT=12 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:23:10.205340 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-5bf1e88a-73fd-4d47-836b-196cee8b1ef1 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "POST /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1/action" status: 202 len: 0 microversion: 2.1 time: 0.375061 Aug 27 02:23:10.210344 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 165/332] 10.222.0.61 () {60 vars in 1278 bytes} [Sat Aug 27 02:23:09 2022] POST /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1/action => generated 0 bytes in 379 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:23:10.234861 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [req-4d08c87f-00fb-4d5b-9e97-3ca5b5a736e0 req-164177e6-f044-4147-9a02-207b80968da9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47d706cc-4f9b-4d59-8eca-caae165ec5db", "name": "network-vif-plugged", "status": "completed", "tag": "118e8d55-f026-4cab-95af-2825721ac127"}]} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:23:10.261052 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-4d08c87f-00fb-4d5b-9e97-3ca5b5a736e0 req-164177e6-f044-4147-9a02-207b80968da9 service nova] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:10.265701 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-4d08c87f-00fb-4d5b-9e97-3ca5b5a736e0 req-164177e6-f044-4147-9a02-207b80968da9 service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:10.268260 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-4d08c87f-00fb-4d5b-9e97-3ca5b5a736e0 req-164177e6-f044-4147-9a02-207b80968da9 service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:10.327392 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.compute.server_external_events [req-4d08c87f-00fb-4d5b-9e97-3ca5b5a736e0 req-164177e6-f044-4147-9a02-207b80968da9 service nova] Creating event network-vif-plugged:118e8d55-f026-4cab-95af-2825721ac127 for instance 47d706cc-4f9b-4d59-8eca-caae165ec5db on hv-cinder-84630 Aug 27 02:23:10.342525 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [req-4d08c87f-00fb-4d5b-9e97-3ca5b5a736e0 req-164177e6-f044-4147-9a02-207b80968da9 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128191 Aug 27 02:23:10.349528 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 166/333] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Aug 27 02:23:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:23:10.388080 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-2ece0a14-0be2-48ae-b1cc-fbf954930ad0 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:10.389289 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-2ece0a14-0be2-48ae-b1cc-fbf954930ad0 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 4fedf0d1-cc1c-4947-b92e-dcb4454889d1] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:10.467126 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2ece0a14-0be2-48ae-b1cc-fbf954930ad0 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:10.469452 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2ece0a14-0be2-48ae-b1cc-fbf954930ad0 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:10.470177 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2ece0a14-0be2-48ae-b1cc-fbf954930ad0 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:10.473782 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2ece0a14-0be2-48ae-b1cc-fbf954930ad0 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:10.474584 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2ece0a14-0be2-48ae-b1cc-fbf954930ad0 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:10.475261 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2ece0a14-0be2-48ae-b1cc-fbf954930ad0 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:10.487673 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:23:10.835114 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-17893256-045d-4fdf-a0ad-c3e7d45ade03 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:10.866187 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-17893256-045d-4fdf-a0ad-c3e7d45ade03 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:10.872404 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-17893256-045d-4fdf-a0ad-c3e7d45ade03 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:10.880567 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-17893256-045d-4fdf-a0ad-c3e7d45ade03 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db" status: 200 len: 1738 microversion: 2.20 time: 1.232897 Aug 27 02:23:10.884856 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 168/334] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:23:09 2022] GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db => generated 1738 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:23:10.898038 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-fa9ddf21-f147-4e02-a2a3-c285bc8081b7 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:10.906632 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-fa9ddf21-f147-4e02-a2a3-c285bc8081b7 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 1b9390be-aab0-4240-83d9-0f815f094605] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:10.928841 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fa9ddf21-f147-4e02-a2a3-c285bc8081b7 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:10.938249 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fa9ddf21-f147-4e02-a2a3-c285bc8081b7 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:10.940012 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fa9ddf21-f147-4e02-a2a3-c285bc8081b7 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:10.943210 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fa9ddf21-f147-4e02-a2a3-c285bc8081b7 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:10.943985 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fa9ddf21-f147-4e02-a2a3-c285bc8081b7 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:10.950282 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fa9ddf21-f147-4e02-a2a3-c285bc8081b7 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:11.798737 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-2ece0a14-0be2-48ae-b1cc-fbf954930ad0 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fbea2c71674b239e6d8fba6518e962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d9d02db5c49fda33321f2914a7f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:11.819893 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-2ece0a14-0be2-48ae-b1cc-fbf954930ad0 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1" status: 200 len: 1706 microversion: 2.1 time: 1.457067 Aug 27 02:23:11.821965 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 167/335] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:23:10 2022] GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1 => generated 1706 bytes in 1467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:23:11.932646 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-8ccacd9e-0739-4b41-8325-bba9aa8d6f96 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:11.933864 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-8ccacd9e-0739-4b41-8325-bba9aa8d6f96 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:11.947694 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8ccacd9e-0739-4b41-8325-bba9aa8d6f96 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:11.952665 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8ccacd9e-0739-4b41-8325-bba9aa8d6f96 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:11.957435 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8ccacd9e-0739-4b41-8325-bba9aa8d6f96 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:11.960612 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8ccacd9e-0739-4b41-8325-bba9aa8d6f96 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:11.963471 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8ccacd9e-0739-4b41-8325-bba9aa8d6f96 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:11.967957 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8ccacd9e-0739-4b41-8325-bba9aa8d6f96 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:12.161736 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-fa9ddf21-f147-4e02-a2a3-c285bc8081b7 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:12.170307 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-fa9ddf21-f147-4e02-a2a3-c285bc8081b7 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605" status: 200 len: 1371 microversion: 2.1 time: 1.282613 Aug 27 02:23:12.175612 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 169/336] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:23:10 2022] GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605 => generated 1371 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:23:12.847202 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-99996894-a2f4-4eed-b50d-7f09c52110fa tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:12.847822 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-99996894-a2f4-4eed-b50d-7f09c52110fa tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 4fedf0d1-cc1c-4947-b92e-dcb4454889d1] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:12.868328 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-99996894-a2f4-4eed-b50d-7f09c52110fa tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:12.874289 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-99996894-a2f4-4eed-b50d-7f09c52110fa tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:12.875291 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-99996894-a2f4-4eed-b50d-7f09c52110fa tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:12.876245 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-99996894-a2f4-4eed-b50d-7f09c52110fa tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:12.876856 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-99996894-a2f4-4eed-b50d-7f09c52110fa tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:12.877523 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-99996894-a2f4-4eed-b50d-7f09c52110fa tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:12.984904 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-8ccacd9e-0739-4b41-8325-bba9aa8d6f96 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:13.018109 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-8ccacd9e-0739-4b41-8325-bba9aa8d6f96 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:13.020797 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-8ccacd9e-0739-4b41-8325-bba9aa8d6f96 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:13.023517 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-8ccacd9e-0739-4b41-8325-bba9aa8d6f96 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db" status: 200 len: 1738 microversion: 2.20 time: 1.095376 Aug 27 02:23:13.026719 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 168/337] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:23:11 2022] GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db => generated 1738 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:23:13.197216 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-89e6a919-e8d9-4dc4-8859-a69c5ed458e5 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:13.199126 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-89e6a919-e8d9-4dc4-8859-a69c5ed458e5 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 1b9390be-aab0-4240-83d9-0f815f094605] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:13.206187 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-89e6a919-e8d9-4dc4-8859-a69c5ed458e5 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:13.207276 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-89e6a919-e8d9-4dc4-8859-a69c5ed458e5 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:13.207939 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-89e6a919-e8d9-4dc4-8859-a69c5ed458e5 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:13.209065 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-89e6a919-e8d9-4dc4-8859-a69c5ed458e5 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:13.210486 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-89e6a919-e8d9-4dc4-8859-a69c5ed458e5 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:13.211613 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-89e6a919-e8d9-4dc4-8859-a69c5ed458e5 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:13.608138 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-99996894-a2f4-4eed-b50d-7f09c52110fa tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fbea2c71674b239e6d8fba6518e962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d9d02db5c49fda33321f2914a7f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:13.631245 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-99996894-a2f4-4eed-b50d-7f09c52110fa tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1" status: 200 len: 1706 microversion: 2.1 time: 0.788695 Aug 27 02:23:13.631765 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 170/338] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:23:12 2022] GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1 => generated 1706 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:23:13.783145 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [req-c852eb56-1046-40e2-a81a-9581228b113d req-7fe89726-d5dd-4654-a819-a980b4df0ffb admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "20943b60-f684-4f1c-9b51-40515029b2ff", "create_info": {"type": "qcow2", "new_file": "volume-20943b60-f684-4f1c-9b51-40515029b2ff.3483fa8d-a02b-4357-891c-98c701f1419f.vhdx", "snapshot_id": "3483fa8d-a02b-4357-891c-98c701f1419f"}}} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:23:13.786411 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-89e6a919-e8d9-4dc4-8859-a69c5ed458e5 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:13.787210 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-c852eb56-1046-40e2-a81a-9581228b113d req-7fe89726-d5dd-4654-a819-a980b4df0ffb admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:13.792000 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-c852eb56-1046-40e2-a81a-9581228b113d req-7fe89726-d5dd-4654-a819-a980b4df0ffb admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:13.795301 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-c852eb56-1046-40e2-a81a-9581228b113d req-7fe89726-d5dd-4654-a819-a980b4df0ffb admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:13.819622 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-89e6a919-e8d9-4dc4-8859-a69c5ed458e5 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605" status: 200 len: 1371 microversion: 2.1 time: 0.625949 Aug 27 02:23:13.834712 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 169/339] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:23:13 2022] GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605 => generated 1371 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:23:13.845069 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-c852eb56-1046-40e2-a81a-9581228b113d req-7fe89726-d5dd-4654-a819-a980b4df0ffb admin admin] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:13.846141 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-c852eb56-1046-40e2-a81a-9581228b113d req-7fe89726-d5dd-4654-a819-a980b4df0ffb admin admin] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:13.849116 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-c852eb56-1046-40e2-a81a-9581228b113d req-7fe89726-d5dd-4654-a819-a980b4df0ffb admin admin] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:13.898080 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [req-a7efbacd-90ba-4441-b256-635e2d2d089b req-4dd3a6c9-810f-426e-86b8-7d3ae07c586e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b9390be-aab0-4240-83d9-0f815f094605", "tag": "2d52c295-4b5b-44d1-aa5d-fbba4fb2a454"}]} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:23:13.903433 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [req-c852eb56-1046-40e2-a81a-9581228b113d req-7fe89726-d5dd-4654-a819-a980b4df0ffb admin admin] 10.222.0.78 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.265726 Aug 27 02:23:13.905197 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 171/340] 10.222.0.78 () {64 vars in 1326 bytes} [Sat Aug 27 02:23:13 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:23:13.936143 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-a7efbacd-90ba-4441-b256-635e2d2d089b req-4dd3a6c9-810f-426e-86b8-7d3ae07c586e service nova] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:13.936939 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-a7efbacd-90ba-4441-b256-635e2d2d089b req-4dd3a6c9-810f-426e-86b8-7d3ae07c586e service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:13.943356 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-a7efbacd-90ba-4441-b256-635e2d2d089b req-4dd3a6c9-810f-426e-86b8-7d3ae07c586e service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:13.994179 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.compute.server_external_events [req-a7efbacd-90ba-4441-b256-635e2d2d089b req-4dd3a6c9-810f-426e-86b8-7d3ae07c586e service nova] Creating event network-changed:2d52c295-4b5b-44d1-aa5d-fbba4fb2a454 for instance 1b9390be-aab0-4240-83d9-0f815f094605 on hv-cinder-84630 Aug 27 02:23:14.017625 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [req-a7efbacd-90ba-4441-b256-635e2d2d089b req-4dd3a6c9-810f-426e-86b8-7d3ae07c586e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126910 Aug 27 02:23:14.022780 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 170/341] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Aug 27 02:23:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:23:14.092811 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-a93c1a4f-15b3-4f12-aa5e-0e91b98d5f30 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:14.096166 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-a93c1a4f-15b3-4f12-aa5e-0e91b98d5f30 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:14.125722 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a93c1a4f-15b3-4f12-aa5e-0e91b98d5f30 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:14.130573 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a93c1a4f-15b3-4f12-aa5e-0e91b98d5f30 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:14.138433 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a93c1a4f-15b3-4f12-aa5e-0e91b98d5f30 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:14.139103 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a93c1a4f-15b3-4f12-aa5e-0e91b98d5f30 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:14.139590 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a93c1a4f-15b3-4f12-aa5e-0e91b98d5f30 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:14.140045 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a93c1a4f-15b3-4f12-aa5e-0e91b98d5f30 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:14.660596 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-399e33e4-e949-40bd-bfad-c2193667f21a tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:14.661473 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-399e33e4-e949-40bd-bfad-c2193667f21a tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 4fedf0d1-cc1c-4947-b92e-dcb4454889d1] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:14.677920 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-399e33e4-e949-40bd-bfad-c2193667f21a tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:14.685691 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-399e33e4-e949-40bd-bfad-c2193667f21a tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:14.693005 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-399e33e4-e949-40bd-bfad-c2193667f21a tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:14.694671 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-399e33e4-e949-40bd-bfad-c2193667f21a tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:14.698583 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-399e33e4-e949-40bd-bfad-c2193667f21a tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:14.701964 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-399e33e4-e949-40bd-bfad-c2193667f21a tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:14.718990 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-a93c1a4f-15b3-4f12-aa5e-0e91b98d5f30 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:14.735150 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-a93c1a4f-15b3-4f12-aa5e-0e91b98d5f30 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:14.736910 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-a93c1a4f-15b3-4f12-aa5e-0e91b98d5f30 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:14.738188 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-a93c1a4f-15b3-4f12-aa5e-0e91b98d5f30 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db" status: 200 len: 1738 microversion: 2.20 time: 0.667293 Aug 27 02:23:14.762862 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 172/342] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:23:14 2022] GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db => generated 1738 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:23:14.855488 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-973ceed0-3871-4aed-a4bd-109f177f8eb0 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:14.856351 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-973ceed0-3871-4aed-a4bd-109f177f8eb0 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 1b9390be-aab0-4240-83d9-0f815f094605] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:14.868274 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-973ceed0-3871-4aed-a4bd-109f177f8eb0 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:14.869084 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-973ceed0-3871-4aed-a4bd-109f177f8eb0 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:14.870968 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-973ceed0-3871-4aed-a4bd-109f177f8eb0 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:14.875793 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-973ceed0-3871-4aed-a4bd-109f177f8eb0 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:14.876637 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-973ceed0-3871-4aed-a4bd-109f177f8eb0 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:14.877277 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-973ceed0-3871-4aed-a4bd-109f177f8eb0 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:15.294709 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-399e33e4-e949-40bd-bfad-c2193667f21a tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fbea2c71674b239e6d8fba6518e962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d9d02db5c49fda33321f2914a7f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:15.323991 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-399e33e4-e949-40bd-bfad-c2193667f21a tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1" status: 200 len: 1706 microversion: 2.1 time: 0.667506 Aug 27 02:23:15.324596 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 171/343] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:23:14 2022] GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1 => generated 1706 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:23:15.770551 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-a0097807-d084-4b20-bd7a-49a41a087467 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:15.771176 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-a0097807-d084-4b20-bd7a-49a41a087467 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:15.801078 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=4 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:23:15.815318 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a0097807-d084-4b20-bd7a-49a41a087467 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:15.824040 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a0097807-d084-4b20-bd7a-49a41a087467 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:15.827726 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a0097807-d084-4b20-bd7a-49a41a087467 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:15.828766 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a0097807-d084-4b20-bd7a-49a41a087467 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:15.829426 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a0097807-d084-4b20-bd7a-49a41a087467 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:15.830038 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a0097807-d084-4b20-bd7a-49a41a087467 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:15.961515 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-973ceed0-3871-4aed-a4bd-109f177f8eb0 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:15.972306 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-973ceed0-3871-4aed-a4bd-109f177f8eb0 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605" status: 200 len: 1371 microversion: 2.1 time: 1.121151 Aug 27 02:23:15.973510 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 173/344] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:23:14 2022] GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605 => generated 1371 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:23:16.347513 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-cd4b3870-cae3-4cc4-970f-9a741d65393a tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:16.348712 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-cd4b3870-cae3-4cc4-970f-9a741d65393a tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 4fedf0d1-cc1c-4947-b92e-dcb4454889d1] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:16.379934 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cd4b3870-cae3-4cc4-970f-9a741d65393a tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:16.380312 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cd4b3870-cae3-4cc4-970f-9a741d65393a tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:16.380956 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cd4b3870-cae3-4cc4-970f-9a741d65393a tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:16.382073 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cd4b3870-cae3-4cc4-970f-9a741d65393a tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:16.382674 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cd4b3870-cae3-4cc4-970f-9a741d65393a tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:16.383930 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cd4b3870-cae3-4cc4-970f-9a741d65393a tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:16.427416 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell1:SELECT=100 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:23:16.448254 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-a0097807-d084-4b20-bd7a-49a41a087467 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:16.488619 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-a0097807-d084-4b20-bd7a-49a41a087467 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:16.491974 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-a0097807-d084-4b20-bd7a-49a41a087467 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:16.508676 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-a0097807-d084-4b20-bd7a-49a41a087467 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db" status: 200 len: 1738 microversion: 2.20 time: 0.739202 Aug 27 02:23:16.517291 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 172/345] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:23:15 2022] GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db => generated 1738 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:23:16.708456 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-cd4b3870-cae3-4cc4-970f-9a741d65393a tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fbea2c71674b239e6d8fba6518e962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d9d02db5c49fda33321f2914a7f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:16.721189 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-cd4b3870-cae3-4cc4-970f-9a741d65393a tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1" status: 200 len: 1706 microversion: 2.1 time: 0.377210 Aug 27 02:23:16.723168 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 174/346] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:23:16 2022] GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1 => generated 1706 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:23:17.000264 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-4dcba21a-7781-4fc6-ad03-04c9a7124849 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:17.003753 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-4dcba21a-7781-4fc6-ad03-04c9a7124849 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 1b9390be-aab0-4240-83d9-0f815f094605] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:17.039169 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4dcba21a-7781-4fc6-ad03-04c9a7124849 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:17.044503 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4dcba21a-7781-4fc6-ad03-04c9a7124849 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:17.047992 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4dcba21a-7781-4fc6-ad03-04c9a7124849 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:17.050275 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4dcba21a-7781-4fc6-ad03-04c9a7124849 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:17.055016 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4dcba21a-7781-4fc6-ad03-04c9a7124849 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:17.062648 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4dcba21a-7781-4fc6-ad03-04c9a7124849 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:17.414652 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-4dcba21a-7781-4fc6-ad03-04c9a7124849 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:17.429360 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-4dcba21a-7781-4fc6-ad03-04c9a7124849 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605" status: 200 len: 1371 microversion: 2.1 time: 0.433735 Aug 27 02:23:17.430582 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 173/347] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:23:16 2022] GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605 => generated 1371 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:23:17.543413 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-3b70fedc-fccd-446c-b482-bc2bf785202f tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:17.544020 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-3b70fedc-fccd-446c-b482-bc2bf785202f tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:17.560963 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3b70fedc-fccd-446c-b482-bc2bf785202f tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:17.561522 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3b70fedc-fccd-446c-b482-bc2bf785202f tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:17.568834 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3b70fedc-fccd-446c-b482-bc2bf785202f tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:17.569900 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3b70fedc-fccd-446c-b482-bc2bf785202f tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:17.570379 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3b70fedc-fccd-446c-b482-bc2bf785202f tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:17.570807 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3b70fedc-fccd-446c-b482-bc2bf785202f tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:17.750041 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-b69ebb3f-d828-4759-8760-7b924c43faf3 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:17.750912 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-b69ebb3f-d828-4759-8760-7b924c43faf3 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 4fedf0d1-cc1c-4947-b92e-dcb4454889d1] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:17.812648 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b69ebb3f-d828-4759-8760-7b924c43faf3 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:17.814891 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b69ebb3f-d828-4759-8760-7b924c43faf3 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:17.818094 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b69ebb3f-d828-4759-8760-7b924c43faf3 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:17.821312 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b69ebb3f-d828-4759-8760-7b924c43faf3 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:17.826120 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b69ebb3f-d828-4759-8760-7b924c43faf3 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:17.830674 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b69ebb3f-d828-4759-8760-7b924c43faf3 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:18.432029 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-3b70fedc-fccd-446c-b482-bc2bf785202f tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:18.458543 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-3b70fedc-fccd-446c-b482-bc2bf785202f tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:18.471097 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-3b70fedc-fccd-446c-b482-bc2bf785202f tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:18.483042 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-3b70fedc-fccd-446c-b482-bc2bf785202f tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db" status: 200 len: 1738 microversion: 2.20 time: 0.949447 Aug 27 02:23:18.488081 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 175/348] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:23:17 2022] GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db => generated 1738 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:23:18.499333 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-f93c509b-34ef-447a-95d3-670b68c3de0d tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:18.501890 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-f93c509b-34ef-447a-95d3-670b68c3de0d tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 1b9390be-aab0-4240-83d9-0f815f094605] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:18.529698 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f93c509b-34ef-447a-95d3-670b68c3de0d tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:18.542019 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f93c509b-34ef-447a-95d3-670b68c3de0d tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:18.543325 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f93c509b-34ef-447a-95d3-670b68c3de0d tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:18.545473 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f93c509b-34ef-447a-95d3-670b68c3de0d tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:18.547471 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f93c509b-34ef-447a-95d3-670b68c3de0d tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:18.549529 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f93c509b-34ef-447a-95d3-670b68c3de0d tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:18.932487 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-f93c509b-34ef-447a-95d3-670b68c3de0d tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:18.946638 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-f93c509b-34ef-447a-95d3-670b68c3de0d tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605" status: 200 len: 1371 microversion: 2.1 time: 0.457265 Aug 27 02:23:18.948094 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 176/349] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:23:18 2022] GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605 => generated 1371 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:23:19.112629 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-53d3ed9f-063f-408c-a6fa-fc0f795a05d2 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Action: 'create', calling method: .version_select at 0x7fd8085c5430>, body: {"keypair": {"name": "tempest-TestShelveInstance-1212741542", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIqw2mctzZLrAiOuPl/5xLInDmBf5tcuZMkvdnmrG9Rfx/2Xe77TA/pC/OTccjZ2DctqvrTthvWfmxYvilyPOWaprmTnzL1mpl25b+tgzugoib2NrHLlQPwBFUpMgyZUPA=="}} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:23:19.158867 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.quota [None req-53d3ed9f-063f-408c-a6fa-fc0f795a05d2 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Getting quotas for project fd2d4ae1c228446eb5bfc64d44348fdf. Resources: {'key_pairs'} {{(pid=120782) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:23:19.173156 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.quota [None req-53d3ed9f-063f-408c-a6fa-fc0f795a05d2 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Getting quotas for user ef7f53d57f3544e5a25e1beeddab9af4 and project fd2d4ae1c228446eb5bfc64d44348fdf. Resources: {'key_pairs'} {{(pid=120782) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:23:19.236867 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-53d3ed9f-063f-408c-a6fa-fc0f795a05d2 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.286958 Aug 27 02:23:19.238216 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 177/350] 10.222.0.61 () {60 vars in 1159 bytes} [Sat Aug 27 02:23:18 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:23:19.419483 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-b69ebb3f-d828-4759-8760-7b924c43faf3 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fbea2c71674b239e6d8fba6518e962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d9d02db5c49fda33321f2914a7f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:19.460721 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-b69ebb3f-d828-4759-8760-7b924c43faf3 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1" status: 200 len: 1710 microversion: 2.1 time: 1.716201 Aug 27 02:23:19.464350 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 174/351] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:23:17 2022] GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1 => generated 1710 bytes in 1722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:23:19.515585 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-d36b381b-4a44-40f4-a380-34d2625ece4d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:19.517172 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-d36b381b-4a44-40f4-a380-34d2625ece4d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:19.546409 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d36b381b-4a44-40f4-a380-34d2625ece4d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:19.550658 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d36b381b-4a44-40f4-a380-34d2625ece4d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:19.555074 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d36b381b-4a44-40f4-a380-34d2625ece4d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:19.561022 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d36b381b-4a44-40f4-a380-34d2625ece4d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:19.564300 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d36b381b-4a44-40f4-a380-34d2625ece4d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:19.565589 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d36b381b-4a44-40f4-a380-34d2625ece4d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:19.813464 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [req-a8711d95-5aef-4f82-ae54-0b71141ac3be req-29fd42aa-e245-431c-b79b-b458cc059974 admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "20943b60-f684-4f1c-9b51-40515029b2ff", "create_info": {"type": "qcow2", "new_file": "volume-20943b60-f684-4f1c-9b51-40515029b2ff.5524e27c-5eb7-43c0-9f10-709c9f67fdc5.vhdx", "snapshot_id": "5524e27c-5eb7-43c0-9f10-709c9f67fdc5"}}} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:23:19.844514 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [req-a8711d95-5aef-4f82-ae54-0b71141ac3be req-29fd42aa-e245-431c-b79b-b458cc059974 admin admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fd1fc341-d010-4ff9-88d0-44b72da91d5f(cell1) {{(pid=120783) load_cells /opt/stack/nova/nova/compute/api.py:319}} Aug 27 02:23:19.847464 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-a8711d95-5aef-4f82-ae54-0b71141ac3be req-29fd42aa-e245-431c-b79b-b458cc059974 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:19.850530 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-a8711d95-5aef-4f82-ae54-0b71141ac3be req-29fd42aa-e245-431c-b79b-b458cc059974 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:19.852385 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-a8711d95-5aef-4f82-ae54-0b71141ac3be req-29fd42aa-e245-431c-b79b-b458cc059974 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:19.993277 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-a8711d95-5aef-4f82-ae54-0b71141ac3be req-29fd42aa-e245-431c-b79b-b458cc059974 admin admin] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:19.994541 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-a8711d95-5aef-4f82-ae54-0b71141ac3be req-29fd42aa-e245-431c-b79b-b458cc059974 admin admin] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:19.995288 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-a8711d95-5aef-4f82-ae54-0b71141ac3be req-29fd42aa-e245-431c-b79b-b458cc059974 admin admin] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:20.055048 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [req-a8711d95-5aef-4f82-ae54-0b71141ac3be req-29fd42aa-e245-431c-b79b-b458cc059974 admin admin] 10.222.0.78 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.386504 Aug 27 02:23:20.056642 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 175/352] 10.222.0.78 () {64 vars in 1326 bytes} [Sat Aug 27 02:23:19 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 27 02:23:20.071780 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-45ad9e46-0ee8-418b-acec-ebe6f86239c5 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:20.073131 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-45ad9e46-0ee8-418b-acec-ebe6f86239c5 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 1b9390be-aab0-4240-83d9-0f815f094605] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:20.090681 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-45ad9e46-0ee8-418b-acec-ebe6f86239c5 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:20.092097 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-45ad9e46-0ee8-418b-acec-ebe6f86239c5 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:20.092825 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-45ad9e46-0ee8-418b-acec-ebe6f86239c5 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:20.096917 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-45ad9e46-0ee8-418b-acec-ebe6f86239c5 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:20.097882 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-45ad9e46-0ee8-418b-acec-ebe6f86239c5 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:20.098790 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-45ad9e46-0ee8-418b-acec-ebe6f86239c5 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:20.392642 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-d36b381b-4a44-40f4-a380-34d2625ece4d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:20.407005 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-d36b381b-4a44-40f4-a380-34d2625ece4d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:20.413610 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-d36b381b-4a44-40f4-a380-34d2625ece4d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:20.416097 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-d36b381b-4a44-40f4-a380-34d2625ece4d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db" status: 200 len: 1738 microversion: 2.20 time: 0.906880 Aug 27 02:23:20.420270 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 178/353] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:23:19 2022] GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db => generated 1738 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:23:20.750505 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-45ad9e46-0ee8-418b-acec-ebe6f86239c5 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:20.762221 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-45ad9e46-0ee8-418b-acec-ebe6f86239c5 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605" status: 200 len: 1371 microversion: 2.1 time: 0.703889 Aug 27 02:23:20.778679 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 176/354] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:23:20 2022] GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605 => generated 1371 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:23:21.447161 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-df7d64a9-33e7-4df8-8f2f-013484f8a2b2 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:21.448889 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-df7d64a9-33e7-4df8-8f2f-013484f8a2b2 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:21.462173 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-df7d64a9-33e7-4df8-8f2f-013484f8a2b2 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:21.465756 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-df7d64a9-33e7-4df8-8f2f-013484f8a2b2 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:21.469944 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-df7d64a9-33e7-4df8-8f2f-013484f8a2b2 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:21.471046 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-df7d64a9-33e7-4df8-8f2f-013484f8a2b2 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:21.471694 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-df7d64a9-33e7-4df8-8f2f-013484f8a2b2 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:21.480025 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-df7d64a9-33e7-4df8-8f2f-013484f8a2b2 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:21.793080 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-1b7c7928-4399-451f-b648-90c6cf8ec95e tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:21.800944 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-1b7c7928-4399-451f-b648-90c6cf8ec95e tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 1b9390be-aab0-4240-83d9-0f815f094605] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:21.874405 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1b7c7928-4399-451f-b648-90c6cf8ec95e tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:21.879397 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1b7c7928-4399-451f-b648-90c6cf8ec95e tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:21.884446 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1b7c7928-4399-451f-b648-90c6cf8ec95e tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:21.892610 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1b7c7928-4399-451f-b648-90c6cf8ec95e tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:21.900357 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1b7c7928-4399-451f-b648-90c6cf8ec95e tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:21.901478 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1b7c7928-4399-451f-b648-90c6cf8ec95e tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:22.250371 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-df7d64a9-33e7-4df8-8f2f-013484f8a2b2 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:22.264011 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-df7d64a9-33e7-4df8-8f2f-013484f8a2b2 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:22.270439 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-df7d64a9-33e7-4df8-8f2f-013484f8a2b2 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:22.283463 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-df7d64a9-33e7-4df8-8f2f-013484f8a2b2 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db" status: 200 len: 1738 microversion: 2.20 time: 0.840954 Aug 27 02:23:22.287379 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 179/355] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:23:21 2022] GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db => generated 1738 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:23:22.646352 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-1b7c7928-4399-451f-b648-90c6cf8ec95e tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:22.666034 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-1b7c7928-4399-451f-b648-90c6cf8ec95e tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605" status: 200 len: 1371 microversion: 2.1 time: 0.884661 Aug 27 02:23:22.667134 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 177/356] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:23:21 2022] GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605 => generated 1371 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:23:23.323372 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-e8981423-51de-41fd-af98-335a5e3e294e tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:23.334847 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-e8981423-51de-41fd-af98-335a5e3e294e tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:23.344868 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e8981423-51de-41fd-af98-335a5e3e294e tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:23.349168 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e8981423-51de-41fd-af98-335a5e3e294e tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:23.360477 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e8981423-51de-41fd-af98-335a5e3e294e tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:23.364695 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e8981423-51de-41fd-af98-335a5e3e294e tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:23.367019 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e8981423-51de-41fd-af98-335a5e3e294e tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:23.367819 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e8981423-51de-41fd-af98-335a5e3e294e tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:23.692648 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-673aab33-8e77-4a44-a358-7a0e0b32b73a tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:23.693778 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-673aab33-8e77-4a44-a358-7a0e0b32b73a tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 1b9390be-aab0-4240-83d9-0f815f094605] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:23.751793 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-673aab33-8e77-4a44-a358-7a0e0b32b73a tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:23.752682 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-673aab33-8e77-4a44-a358-7a0e0b32b73a tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:23.753479 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-673aab33-8e77-4a44-a358-7a0e0b32b73a tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:23.774421 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-673aab33-8e77-4a44-a358-7a0e0b32b73a tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:23.775905 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-673aab33-8e77-4a44-a358-7a0e0b32b73a tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:23.776898 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-673aab33-8e77-4a44-a358-7a0e0b32b73a tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:23.787810 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-e8981423-51de-41fd-af98-335a5e3e294e tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:23.798844 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-e8981423-51de-41fd-af98-335a5e3e294e tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:23.814028 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-e8981423-51de-41fd-af98-335a5e3e294e tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:23.815490 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-e8981423-51de-41fd-af98-335a5e3e294e tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db" status: 200 len: 1738 microversion: 2.20 time: 0.500787 Aug 27 02:23:23.816151 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 180/357] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:23:23 2022] GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db => generated 1738 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:23:24.041007 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell0:SELECT=4 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:23:24.234776 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-673aab33-8e77-4a44-a358-7a0e0b32b73a tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:24.243812 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [req-53f1c277-b116-4e4e-8219-1f2915c4c133 req-90c7bd32-42dd-4c2d-b857-75eeeb8a7a8a admin admin] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:24.261456 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-53f1c277-b116-4e4e-8219-1f2915c4c133 req-90c7bd32-42dd-4c2d-b857-75eeeb8a7a8a admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:24.265222 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-53f1c277-b116-4e4e-8219-1f2915c4c133 req-90c7bd32-42dd-4c2d-b857-75eeeb8a7a8a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:24.267455 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-53f1c277-b116-4e4e-8219-1f2915c4c133 req-90c7bd32-42dd-4c2d-b857-75eeeb8a7a8a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:24.271874 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-673aab33-8e77-4a44-a358-7a0e0b32b73a tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605" status: 200 len: 1371 microversion: 2.1 time: 0.587409 Aug 27 02:23:24.274965 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 178/358] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:23:23 2022] GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605 => generated 1371 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:23:24.282400 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-53f1c277-b116-4e4e-8219-1f2915c4c133 req-90c7bd32-42dd-4c2d-b857-75eeeb8a7a8a admin admin] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:24.283497 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-53f1c277-b116-4e4e-8219-1f2915c4c133 req-90c7bd32-42dd-4c2d-b857-75eeeb8a7a8a admin admin] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:24.284145 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-53f1c277-b116-4e4e-8219-1f2915c4c133 req-90c7bd32-42dd-4c2d-b857-75eeeb8a7a8a admin admin] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:24.342934 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [req-53f1c277-b116-4e4e-8219-1f2915c4c133 req-90c7bd32-42dd-4c2d-b857-75eeeb8a7a8a admin admin] 10.222.0.78 "DELETE /compute/v2.1/os-assisted-volume-snapshots/db99e778-90e1-43ce-bb13-d8e1d472ca05?delete_info=%7B%22file_to_merge%22:%20%22volume-20943b60-f684-4f1c-9b51-40515029b2ff.db99e778-90e1-43ce-bb13-d8e1d472ca05.vhdx%22,%20%22volume_id%22:%20%2220943b60-f684-4f1c-9b51-40515029b2ff%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.305086 Aug 27 02:23:24.344627 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 181/359] 10.222.0.78 () {62 vars in 1800 bytes} [Sat Aug 27 02:23:24 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/db99e778-90e1-43ce-bb13-d8e1d472ca05?delete_info=%7B%22file_to_merge%22:%20%22volume-20943b60-f684-4f1c-9b51-40515029b2ff.db99e778-90e1-43ce-bb13-d8e1d472ca05.vhdx%22,%20%22volume_id%22:%20%2220943b60-f684-4f1c-9b51-40515029b2ff%22%7D => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 02:23:24.843900 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-fb8631f6-b8e2-46db-81cf-18efd6614e7e tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:24.844877 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-fb8631f6-b8e2-46db-81cf-18efd6614e7e tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:24.869107 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fb8631f6-b8e2-46db-81cf-18efd6614e7e tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:24.869683 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fb8631f6-b8e2-46db-81cf-18efd6614e7e tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:24.870847 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fb8631f6-b8e2-46db-81cf-18efd6614e7e tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:24.885216 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fb8631f6-b8e2-46db-81cf-18efd6614e7e tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:24.888496 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fb8631f6-b8e2-46db-81cf-18efd6614e7e tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:24.889219 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fb8631f6-b8e2-46db-81cf-18efd6614e7e tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:25.312255 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-3665f252-ee17-4e6f-8379-006c283d90da tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:25.313277 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-3665f252-ee17-4e6f-8379-006c283d90da tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 1b9390be-aab0-4240-83d9-0f815f094605] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:25.322422 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-fb8631f6-b8e2-46db-81cf-18efd6614e7e tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:25.332934 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-fb8631f6-b8e2-46db-81cf-18efd6614e7e tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:25.337968 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3665f252-ee17-4e6f-8379-006c283d90da tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:25.341242 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-fb8631f6-b8e2-46db-81cf-18efd6614e7e tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:25.342856 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-fb8631f6-b8e2-46db-81cf-18efd6614e7e tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db" status: 200 len: 1738 microversion: 2.20 time: 0.503082 Aug 27 02:23:25.343211 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3665f252-ee17-4e6f-8379-006c283d90da tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:25.344284 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3665f252-ee17-4e6f-8379-006c283d90da tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:25.345214 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3665f252-ee17-4e6f-8379-006c283d90da tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:25.364317 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3665f252-ee17-4e6f-8379-006c283d90da tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:25.365193 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 179/360] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:23:24 2022] GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db => generated 1738 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:23:25.366090 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3665f252-ee17-4e6f-8379-006c283d90da tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:25.554794 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-3665f252-ee17-4e6f-8379-006c283d90da tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:25.568190 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-3665f252-ee17-4e6f-8379-006c283d90da tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605" status: 200 len: 1371 microversion: 2.1 time: 0.262898 Aug 27 02:23:25.569721 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 182/361] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:23:25 2022] GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605 => generated 1371 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:23:25.954249 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [req-83e35100-048f-4f67-87fc-158eba53fdb4 req-194f0db3-a71f-407b-9114-51594806aa0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b9390be-aab0-4240-83d9-0f815f094605", "name": "network-vif-plugged", "status": "completed", "tag": "2d52c295-4b5b-44d1-aa5d-fbba4fb2a454"}]} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:23:25.986001 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-83e35100-048f-4f67-87fc-158eba53fdb4 req-194f0db3-a71f-407b-9114-51594806aa0a service nova] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:25.989372 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-83e35100-048f-4f67-87fc-158eba53fdb4 req-194f0db3-a71f-407b-9114-51594806aa0a service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:25.992744 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-83e35100-048f-4f67-87fc-158eba53fdb4 req-194f0db3-a71f-407b-9114-51594806aa0a service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:26.054460 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.compute.server_external_events [req-83e35100-048f-4f67-87fc-158eba53fdb4 req-194f0db3-a71f-407b-9114-51594806aa0a service nova] Creating event network-vif-plugged:2d52c295-4b5b-44d1-aa5d-fbba4fb2a454 for instance 1b9390be-aab0-4240-83d9-0f815f094605 on hv-cinder-84630 Aug 27 02:23:26.086224 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [req-83e35100-048f-4f67-87fc-158eba53fdb4 req-194f0db3-a71f-407b-9114-51594806aa0a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130753 Aug 27 02:23:26.096201 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 180/362] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Aug 27 02:23:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:23:26.419121 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-86f78c7b-7954-4d24-8cbb-339b7f14ff7d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:26.424839 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-86f78c7b-7954-4d24-8cbb-339b7f14ff7d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:26.450750 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-86f78c7b-7954-4d24-8cbb-339b7f14ff7d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:26.453370 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-86f78c7b-7954-4d24-8cbb-339b7f14ff7d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:26.454116 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-86f78c7b-7954-4d24-8cbb-339b7f14ff7d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:26.458018 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-86f78c7b-7954-4d24-8cbb-339b7f14ff7d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:26.458846 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-86f78c7b-7954-4d24-8cbb-339b7f14ff7d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:26.459497 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-86f78c7b-7954-4d24-8cbb-339b7f14ff7d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:26.595429 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-fc84e5b5-e96b-439e-8aa6-207a5f1172cc tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:26.601249 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-fc84e5b5-e96b-439e-8aa6-207a5f1172cc tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 1b9390be-aab0-4240-83d9-0f815f094605] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:26.691531 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fc84e5b5-e96b-439e-8aa6-207a5f1172cc tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:26.712422 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fc84e5b5-e96b-439e-8aa6-207a5f1172cc tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:26.715489 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fc84e5b5-e96b-439e-8aa6-207a5f1172cc tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:26.717013 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fc84e5b5-e96b-439e-8aa6-207a5f1172cc tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:26.733584 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fc84e5b5-e96b-439e-8aa6-207a5f1172cc tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:26.736616 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fc84e5b5-e96b-439e-8aa6-207a5f1172cc tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:26.809509 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-86f78c7b-7954-4d24-8cbb-339b7f14ff7d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:26.829273 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-86f78c7b-7954-4d24-8cbb-339b7f14ff7d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:26.835196 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-86f78c7b-7954-4d24-8cbb-339b7f14ff7d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:26.838157 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-86f78c7b-7954-4d24-8cbb-339b7f14ff7d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db" status: 200 len: 1738 microversion: 2.20 time: 0.441298 Aug 27 02:23:26.841058 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 183/363] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:23:26 2022] GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db => generated 1738 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:23:27.396086 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-fc84e5b5-e96b-439e-8aa6-207a5f1172cc tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:27.414203 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-fc84e5b5-e96b-439e-8aa6-207a5f1172cc tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605" status: 200 len: 1371 microversion: 2.1 time: 0.826888 Aug 27 02:23:27.422045 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 181/364] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:23:26 2022] GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605 => generated 1371 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:23:27.886021 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-2069bb6b-6f2b-489c-8f44-6aa3386403b6 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:27.887351 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-2069bb6b-6f2b-489c-8f44-6aa3386403b6 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:27.908254 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2069bb6b-6f2b-489c-8f44-6aa3386403b6 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:27.916279 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2069bb6b-6f2b-489c-8f44-6aa3386403b6 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:27.921519 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2069bb6b-6f2b-489c-8f44-6aa3386403b6 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:27.922619 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2069bb6b-6f2b-489c-8f44-6aa3386403b6 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:27.923277 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2069bb6b-6f2b-489c-8f44-6aa3386403b6 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:27.923890 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2069bb6b-6f2b-489c-8f44-6aa3386403b6 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:28.410584 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-2069bb6b-6f2b-489c-8f44-6aa3386403b6 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:28.427968 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-2069bb6b-6f2b-489c-8f44-6aa3386403b6 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:28.433294 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-2069bb6b-6f2b-489c-8f44-6aa3386403b6 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:28.435405 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-2069bb6b-6f2b-489c-8f44-6aa3386403b6 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db" status: 200 len: 1738 microversion: 2.20 time: 0.553971 Aug 27 02:23:28.438063 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 184/365] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:23:27 2022] GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db => generated 1738 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:23:28.470946 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-8be4a19f-4467-4e05-b579-0b709a859925 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:28.471814 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-8be4a19f-4467-4e05-b579-0b709a859925 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 1b9390be-aab0-4240-83d9-0f815f094605] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:28.489139 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8be4a19f-4467-4e05-b579-0b709a859925 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:28.490146 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8be4a19f-4467-4e05-b579-0b709a859925 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:28.492633 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8be4a19f-4467-4e05-b579-0b709a859925 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:28.502409 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8be4a19f-4467-4e05-b579-0b709a859925 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:28.503441 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8be4a19f-4467-4e05-b579-0b709a859925 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:28.504342 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8be4a19f-4467-4e05-b579-0b709a859925 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:28.895389 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-8be4a19f-4467-4e05-b579-0b709a859925 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:28.914113 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-8be4a19f-4467-4e05-b579-0b709a859925 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605" status: 200 len: 1371 microversion: 2.1 time: 0.449988 Aug 27 02:23:28.916009 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 182/366] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:23:28 2022] GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605 => generated 1371 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:23:29.198234 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell0:SELECT=4 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:23:29.453126 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [req-118368e4-d71c-4fba-a95b-16107303000a req-e5aaa926-0a10-4387-8b4d-8069046bbc86 admin admin] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:29.457367 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-118368e4-d71c-4fba-a95b-16107303000a req-e5aaa926-0a10-4387-8b4d-8069046bbc86 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:29.458998 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-118368e4-d71c-4fba-a95b-16107303000a req-e5aaa926-0a10-4387-8b4d-8069046bbc86 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:29.459724 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-118368e4-d71c-4fba-a95b-16107303000a req-e5aaa926-0a10-4387-8b4d-8069046bbc86 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:29.474017 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-118368e4-d71c-4fba-a95b-16107303000a req-e5aaa926-0a10-4387-8b4d-8069046bbc86 admin admin] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:29.474815 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-118368e4-d71c-4fba-a95b-16107303000a req-e5aaa926-0a10-4387-8b4d-8069046bbc86 admin admin] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:29.475472 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-118368e4-d71c-4fba-a95b-16107303000a req-e5aaa926-0a10-4387-8b4d-8069046bbc86 admin admin] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:29.495484 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-b7f043f2-8274-4913-b3a1-1cb72f443a68 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:29.496315 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [req-118368e4-d71c-4fba-a95b-16107303000a req-e5aaa926-0a10-4387-8b4d-8069046bbc86 admin admin] 10.222.0.78 "DELETE /compute/v2.1/os-assisted-volume-snapshots/5524e27c-5eb7-43c0-9f10-709c9f67fdc5?delete_info=%7B%22file_to_merge%22:%20%22volume-20943b60-f684-4f1c-9b51-40515029b2ff.5524e27c-5eb7-43c0-9f10-709c9f67fdc5.vhdx%22,%20%22volume_id%22:%20%2220943b60-f684-4f1c-9b51-40515029b2ff%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.381946 Aug 27 02:23:29.496561 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-b7f043f2-8274-4913-b3a1-1cb72f443a68 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:29.497623 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 185/367] 10.222.0.78 () {62 vars in 1800 bytes} [Sat Aug 27 02:23:29 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/5524e27c-5eb7-43c0-9f10-709c9f67fdc5?delete_info=%7B%22file_to_merge%22:%20%22volume-20943b60-f684-4f1c-9b51-40515029b2ff.5524e27c-5eb7-43c0-9f10-709c9f67fdc5.vhdx%22,%20%22volume_id%22:%20%2220943b60-f684-4f1c-9b51-40515029b2ff%22%7D => generated 0 bytes in 385 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:23:29.513309 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b7f043f2-8274-4913-b3a1-1cb72f443a68 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:29.514266 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b7f043f2-8274-4913-b3a1-1cb72f443a68 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:29.515117 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b7f043f2-8274-4913-b3a1-1cb72f443a68 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:29.516202 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b7f043f2-8274-4913-b3a1-1cb72f443a68 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:29.517723 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b7f043f2-8274-4913-b3a1-1cb72f443a68 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:29.523148 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b7f043f2-8274-4913-b3a1-1cb72f443a68 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:29.971664 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-b7f043f2-8274-4913-b3a1-1cb72f443a68 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:29.986932 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-204ddbb7-c12c-49c6-a309-fa61dc945062 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:29.989895 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell0:SELECT=2 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:23:29.993049 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-204ddbb7-c12c-49c6-a309-fa61dc945062 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 1b9390be-aab0-4240-83d9-0f815f094605] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:30.001843 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-b7f043f2-8274-4913-b3a1-1cb72f443a68 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:30.003331 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-b7f043f2-8274-4913-b3a1-1cb72f443a68 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:30.004561 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-b7f043f2-8274-4913-b3a1-1cb72f443a68 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db" status: 200 len: 1738 microversion: 2.20 time: 0.515781 Aug 27 02:23:30.008925 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 183/368] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:23:29 2022] GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db => generated 1738 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:23:30.017624 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-204ddbb7-c12c-49c6-a309-fa61dc945062 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:30.019399 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-204ddbb7-c12c-49c6-a309-fa61dc945062 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:30.020417 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-204ddbb7-c12c-49c6-a309-fa61dc945062 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:30.021912 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-204ddbb7-c12c-49c6-a309-fa61dc945062 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:30.022903 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-204ddbb7-c12c-49c6-a309-fa61dc945062 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:30.024917 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-204ddbb7-c12c-49c6-a309-fa61dc945062 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:30.342239 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-204ddbb7-c12c-49c6-a309-fa61dc945062 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:30.364183 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-204ddbb7-c12c-49c6-a309-fa61dc945062 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605" status: 200 len: 1564 microversion: 2.1 time: 0.385380 Aug 27 02:23:30.366029 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 186/369] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:23:29 2022] GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605 => generated 1564 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:23:30.410898 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-bcbb95d6-6c39-46b8-b0b9-4a922cb7a0ca tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:30.414717 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-bcbb95d6-6c39-46b8-b0b9-4a922cb7a0ca tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 1b9390be-aab0-4240-83d9-0f815f094605] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:30.429081 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bcbb95d6-6c39-46b8-b0b9-4a922cb7a0ca tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:30.430213 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bcbb95d6-6c39-46b8-b0b9-4a922cb7a0ca tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:30.430829 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bcbb95d6-6c39-46b8-b0b9-4a922cb7a0ca tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:30.431737 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bcbb95d6-6c39-46b8-b0b9-4a922cb7a0ca tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:30.432528 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bcbb95d6-6c39-46b8-b0b9-4a922cb7a0ca tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:30.433269 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bcbb95d6-6c39-46b8-b0b9-4a922cb7a0ca tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:30.638909 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-bcbb95d6-6c39-46b8-b0b9-4a922cb7a0ca tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.234332 Aug 27 02:23:30.657768 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 184/370] 10.222.0.61 () {58 vars in 1275 bytes} [Sat Aug 27 02:23:30 2022] GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605/os-interface => generated 284 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:23:31.030128 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-28581506-8ab7-4cb7-a7ff-a09ed9d2abc4 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:31.030929 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-28581506-8ab7-4cb7-a7ff-a09ed9d2abc4 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:31.045577 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-28581506-8ab7-4cb7-a7ff-a09ed9d2abc4 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:31.051915 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-28581506-8ab7-4cb7-a7ff-a09ed9d2abc4 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:31.062903 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-28581506-8ab7-4cb7-a7ff-a09ed9d2abc4 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:31.064089 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-28581506-8ab7-4cb7-a7ff-a09ed9d2abc4 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:31.064803 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-28581506-8ab7-4cb7-a7ff-a09ed9d2abc4 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:31.065600 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-28581506-8ab7-4cb7-a7ff-a09ed9d2abc4 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:31.601637 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-28581506-8ab7-4cb7-a7ff-a09ed9d2abc4 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:31.618822 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-28581506-8ab7-4cb7-a7ff-a09ed9d2abc4 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:31.620752 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-28581506-8ab7-4cb7-a7ff-a09ed9d2abc4 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:31.622332 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-28581506-8ab7-4cb7-a7ff-a09ed9d2abc4 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db" status: 200 len: 1738 microversion: 2.20 time: 0.596238 Aug 27 02:23:31.623095 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 187/371] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:23:31 2022] GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db => generated 1738 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:23:32.657053 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-c385a8b9-0b64-4a70-8ea7-912d4af09203 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:32.664170 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-c385a8b9-0b64-4a70-8ea7-912d4af09203 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:32.733951 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c385a8b9-0b64-4a70-8ea7-912d4af09203 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:32.735280 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c385a8b9-0b64-4a70-8ea7-912d4af09203 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:32.736451 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c385a8b9-0b64-4a70-8ea7-912d4af09203 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:32.741107 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c385a8b9-0b64-4a70-8ea7-912d4af09203 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:32.744933 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c385a8b9-0b64-4a70-8ea7-912d4af09203 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:32.782497 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c385a8b9-0b64-4a70-8ea7-912d4af09203 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:32.920180 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [req-689737ed-6b1d-400d-8ccd-032a23afe01e req-915fab09-8d21-42e1-9766-68345e8e8e5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b9390be-aab0-4240-83d9-0f815f094605", "tag": "2d52c295-4b5b-44d1-aa5d-fbba4fb2a454"}]} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:23:32.946715 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-689737ed-6b1d-400d-8ccd-032a23afe01e req-915fab09-8d21-42e1-9766-68345e8e8e5c service nova] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:32.947202 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-689737ed-6b1d-400d-8ccd-032a23afe01e req-915fab09-8d21-42e1-9766-68345e8e8e5c service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:32.947688 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-689737ed-6b1d-400d-8ccd-032a23afe01e req-915fab09-8d21-42e1-9766-68345e8e8e5c service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:32.983907 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.compute.server_external_events [req-689737ed-6b1d-400d-8ccd-032a23afe01e req-915fab09-8d21-42e1-9766-68345e8e8e5c service nova] Creating event network-changed:2d52c295-4b5b-44d1-aa5d-fbba4fb2a454 for instance 1b9390be-aab0-4240-83d9-0f815f094605 on hv-cinder-84630 Aug 27 02:23:32.998769 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [req-689737ed-6b1d-400d-8ccd-032a23afe01e req-915fab09-8d21-42e1-9766-68345e8e8e5c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103572 Aug 27 02:23:33.009241 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 188/372] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Aug 27 02:23:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:23:33.223185 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-c385a8b9-0b64-4a70-8ea7-912d4af09203 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:33.265258 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-c385a8b9-0b64-4a70-8ea7-912d4af09203 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:33.275541 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-c385a8b9-0b64-4a70-8ea7-912d4af09203 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:33.281314 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-c385a8b9-0b64-4a70-8ea7-912d4af09203 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db" status: 200 len: 1738 microversion: 2.20 time: 0.634672 Aug 27 02:23:33.282304 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 185/373] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:23:32 2022] GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db => generated 1738 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:23:33.714455 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [req-da8b8a30-d5a7-4dfe-a79f-dbb83f6b8cd3 req-170ba1c8-e814-4285-a0ff-497c6e464237 admin admin] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:33.720120 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-da8b8a30-d5a7-4dfe-a79f-dbb83f6b8cd3 req-170ba1c8-e814-4285-a0ff-497c6e464237 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:33.721010 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-da8b8a30-d5a7-4dfe-a79f-dbb83f6b8cd3 req-170ba1c8-e814-4285-a0ff-497c6e464237 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:33.721661 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-da8b8a30-d5a7-4dfe-a79f-dbb83f6b8cd3 req-170ba1c8-e814-4285-a0ff-497c6e464237 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:33.732319 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-da8b8a30-d5a7-4dfe-a79f-dbb83f6b8cd3 req-170ba1c8-e814-4285-a0ff-497c6e464237 admin admin] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:33.733090 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-da8b8a30-d5a7-4dfe-a79f-dbb83f6b8cd3 req-170ba1c8-e814-4285-a0ff-497c6e464237 admin admin] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:33.733924 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-da8b8a30-d5a7-4dfe-a79f-dbb83f6b8cd3 req-170ba1c8-e814-4285-a0ff-497c6e464237 admin admin] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:33.780366 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [req-da8b8a30-d5a7-4dfe-a79f-dbb83f6b8cd3 req-170ba1c8-e814-4285-a0ff-497c6e464237 admin admin] 10.222.0.78 "DELETE /compute/v2.1/os-assisted-volume-snapshots/3483fa8d-a02b-4357-891c-98c701f1419f?delete_info=%7B%22file_to_merge%22:%20%22volume-20943b60-f684-4f1c-9b51-40515029b2ff.3483fa8d-a02b-4357-891c-98c701f1419f.vhdx%22,%20%22volume_id%22:%20%2220943b60-f684-4f1c-9b51-40515029b2ff%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.342740 Aug 27 02:23:33.781204 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 189/374] 10.222.0.78 () {62 vars in 1800 bytes} [Sat Aug 27 02:23:33 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/3483fa8d-a02b-4357-891c-98c701f1419f?delete_info=%7B%22file_to_merge%22:%20%22volume-20943b60-f684-4f1c-9b51-40515029b2ff.3483fa8d-a02b-4357-891c-98c701f1419f.vhdx%22,%20%22volume_id%22:%20%2220943b60-f684-4f1c-9b51-40515029b2ff%22%7D => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:23:34.330150 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-425c95fc-8f9e-43e9-8800-6d4a35ac0273 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:34.331946 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-425c95fc-8f9e-43e9-8800-6d4a35ac0273 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:34.346216 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-425c95fc-8f9e-43e9-8800-6d4a35ac0273 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:34.347421 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-425c95fc-8f9e-43e9-8800-6d4a35ac0273 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:34.347987 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-425c95fc-8f9e-43e9-8800-6d4a35ac0273 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:34.348824 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-425c95fc-8f9e-43e9-8800-6d4a35ac0273 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:34.349428 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-425c95fc-8f9e-43e9-8800-6d4a35ac0273 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:34.358985 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-425c95fc-8f9e-43e9-8800-6d4a35ac0273 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:34.419777 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell1:SELECT=100 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:23:34.705356 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-425c95fc-8f9e-43e9-8800-6d4a35ac0273 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:34.722763 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-425c95fc-8f9e-43e9-8800-6d4a35ac0273 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:34.727047 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-425c95fc-8f9e-43e9-8800-6d4a35ac0273 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:34.732389 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-425c95fc-8f9e-43e9-8800-6d4a35ac0273 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db" status: 200 len: 1738 microversion: 2.20 time: 0.406102 Aug 27 02:23:34.733414 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 186/375] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:23:34 2022] GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db => generated 1738 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:23:35.793306 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-26a7ea61-c94f-4fed-b6a4-b26a79de2138 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:35.796343 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-26a7ea61-c94f-4fed-b6a4-b26a79de2138 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:35.814209 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-26a7ea61-c94f-4fed-b6a4-b26a79de2138 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:35.816129 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-26a7ea61-c94f-4fed-b6a4-b26a79de2138 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:35.817635 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-26a7ea61-c94f-4fed-b6a4-b26a79de2138 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:35.819608 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-26a7ea61-c94f-4fed-b6a4-b26a79de2138 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:35.820820 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-26a7ea61-c94f-4fed-b6a4-b26a79de2138 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:35.821988 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-26a7ea61-c94f-4fed-b6a4-b26a79de2138 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:36.228817 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-26a7ea61-c94f-4fed-b6a4-b26a79de2138 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:36.244737 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-26a7ea61-c94f-4fed-b6a4-b26a79de2138 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:36.253188 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-26a7ea61-c94f-4fed-b6a4-b26a79de2138 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:36.255674 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-26a7ea61-c94f-4fed-b6a4-b26a79de2138 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db" status: 200 len: 1738 microversion: 2.20 time: 0.480595 Aug 27 02:23:36.257314 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 190/376] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:23:35 2022] GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db => generated 1738 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:23:37.189320 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-3652447b-8aed-47a4-912f-abb9004e86d6 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Action: 'create', calling method: .version_select at 0x7fd8085278b0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1390106949", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDlWXTiai5aL+Y3BmNHp0U7GetdkSxL6t7OhwTNP/yvDp7seQfxuWeXoqLfVXmSu9vl0fQN+xxNr9h1KKPsX0MDtMxfApJmNDbdssslel2QysBaJAzW0Ci/Fc8JH1LouPg=="}} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:23:37.206763 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.quota [None req-3652447b-8aed-47a4-912f-abb9004e86d6 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Getting quotas for project fe4f956d4d27437c830871f6634a3018. Resources: {'key_pairs'} {{(pid=120783) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:23:37.211111 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.quota [None req-3652447b-8aed-47a4-912f-abb9004e86d6 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Getting quotas for user 931dcabba0214e3daa878f31cd1706cc and project fe4f956d4d27437c830871f6634a3018. Resources: {'key_pairs'} {{(pid=120783) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:23:37.242780 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-3652447b-8aed-47a4-912f-abb9004e86d6 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.057626 Aug 27 02:23:37.243778 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 187/377] 10.222.0.61 () {60 vars in 1159 bytes} [Sat Aug 27 02:23:37 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:23:37.286026 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-cc0faa68-176f-4452-8c72-05ca0f07191f tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:37.287254 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-cc0faa68-176f-4452-8c72-05ca0f07191f tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:37.297659 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cc0faa68-176f-4452-8c72-05ca0f07191f tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:37.298631 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cc0faa68-176f-4452-8c72-05ca0f07191f tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:37.299458 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cc0faa68-176f-4452-8c72-05ca0f07191f tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:37.300830 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cc0faa68-176f-4452-8c72-05ca0f07191f tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:37.301552 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cc0faa68-176f-4452-8c72-05ca0f07191f tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:37.308149 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cc0faa68-176f-4452-8c72-05ca0f07191f tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:37.410339 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-e33e1cfc-e7a7-492a-8b77-f93efe54bb8b tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-710442668", "imageRef": "676b7457-0485-487a-90d6-bfb0ae0bc7db", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1390106949", "networks": [{"uuid": "0ecdcae2-f7d4-45ca-afb6-0d4da5afdfd1"}]}} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:23:37.476560 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.network.neutron [None req-e33e1cfc-e7a7-492a-8b77-f93efe54bb8b tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] validate_networks() for [('0ecdcae2-f7d4-45ca-afb6-0d4da5afdfd1', None, None, None, None, None)] {{(pid=120783) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:23:37.813238 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-cc0faa68-176f-4452-8c72-05ca0f07191f tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:37.828783 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-cc0faa68-176f-4452-8c72-05ca0f07191f tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:37.831652 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-cc0faa68-176f-4452-8c72-05ca0f07191f tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:37.833761 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-cc0faa68-176f-4452-8c72-05ca0f07191f tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db" status: 200 len: 1720 microversion: 2.20 time: 0.554009 Aug 27 02:23:37.834939 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 191/378] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:23:37 2022] GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db => generated 1720 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:23:37.843900 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-e8b1f5a1-11f1-4a24-af4a-29aa029fd1b6 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:37.845204 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-e8b1f5a1-11f1-4a24-af4a-29aa029fd1b6 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] [instance: 35d91cb7-f14b-4788-b503-ea9feaee650b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:37.856591 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e8b1f5a1-11f1-4a24-af4a-29aa029fd1b6 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:37.859880 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e8b1f5a1-11f1-4a24-af4a-29aa029fd1b6 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:37.859880 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e8b1f5a1-11f1-4a24-af4a-29aa029fd1b6 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:37.859880 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e8b1f5a1-11f1-4a24-af4a-29aa029fd1b6 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:37.860522 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e8b1f5a1-11f1-4a24-af4a-29aa029fd1b6 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:37.861570 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e8b1f5a1-11f1-4a24-af4a-29aa029fd1b6 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:37.964850 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.virt.hardware [None req-e33e1cfc-e7a7-492a-8b77-f93efe54bb8b tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Flavor limits 0:0:0 {{(pid=120783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:23:37.965774 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.virt.hardware [None req-e33e1cfc-e7a7-492a-8b77-f93efe54bb8b tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Image limits 0:0:0 {{(pid=120783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:23:37.966372 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.virt.hardware [None req-e33e1cfc-e7a7-492a-8b77-f93efe54bb8b tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Flavor pref 0:0:0 {{(pid=120783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:23:37.966867 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.virt.hardware [None req-e33e1cfc-e7a7-492a-8b77-f93efe54bb8b tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Image pref 0:0:0 {{(pid=120783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:23:37.967366 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.virt.hardware [None req-e33e1cfc-e7a7-492a-8b77-f93efe54bb8b tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:23:37.979437 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e33e1cfc-e7a7-492a-8b77-f93efe54bb8b tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:37.980031 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e33e1cfc-e7a7-492a-8b77-f93efe54bb8b tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:37.980642 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e33e1cfc-e7a7-492a-8b77-f93efe54bb8b tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:37.981516 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e33e1cfc-e7a7-492a-8b77-f93efe54bb8b tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:37.982056 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e33e1cfc-e7a7-492a-8b77-f93efe54bb8b tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:37.982712 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e33e1cfc-e7a7-492a-8b77-f93efe54bb8b tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:38.005994 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.quota [None req-e33e1cfc-e7a7-492a-8b77-f93efe54bb8b tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Getting quotas for project fe4f956d4d27437c830871f6634a3018. Resources: {'instances', 'ram', 'cores'} {{(pid=120783) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:23:38.011809 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.quota [None req-e33e1cfc-e7a7-492a-8b77-f93efe54bb8b tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Getting quotas for user 931dcabba0214e3daa878f31cd1706cc and project fe4f956d4d27437c830871f6634a3018. Resources: {'instances', 'ram', 'cores'} {{(pid=120783) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:23:38.031746 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-e33e1cfc-e7a7-492a-8b77-f93efe54bb8b tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Going to run 1 instances... {{(pid=120783) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:23:38.034205 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-e33e1cfc-e7a7-492a-8b77-f93efe54bb8b tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] [instance: 49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='676b7457-0485-487a-90d6-bfb0ae0bc7db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120783) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:23:38.041024 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.objects.instance [None req-e8b1f5a1-11f1-4a24-af4a-29aa029fd1b6 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lazy-loading 'services' on Instance uuid 35d91cb7-f14b-4788-b503-ea9feaee650b {{(pid=120782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:23:38.111417 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-e33e1cfc-e7a7-492a-8b77-f93efe54bb8b tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.705010 Aug 27 02:23:38.114191 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 188/379] 10.222.0.61 () {60 vars in 1147 bytes} [Sat Aug 27 02:23:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 707 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 02:23:38.127729 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-2fe8fc83-b612-463c-819e-7dd31c5b2f9c tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:38.128582 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-2fe8fc83-b612-463c-819e-7dd31c5b2f9c tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] [instance: 49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:38.188304 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-e8b1f5a1-11f1-4a24-af4a-29aa029fd1b6 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] 10.222.0.61 "DELETE /compute/v2.1/servers/35d91cb7-f14b-4788-b503-ea9feaee650b/os-volume_attachments/20943b60-f684-4f1c-9b51-40515029b2ff" status: 202 len: 0 microversion: 2.1 time: 0.351122 Aug 27 02:23:38.188641 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 192/380] 10.222.0.61 () {58 vars in 1416 bytes} [Sat Aug 27 02:23:37 2022] DELETE /compute/v2.1/servers/35d91cb7-f14b-4788-b503-ea9feaee650b/os-volume_attachments/20943b60-f684-4f1c-9b51-40515029b2ff => generated 0 bytes in 353 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:23:38.209006 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-2fe8fc83-b612-463c-819e-7dd31c5b2f9c tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931dcabba0214e3daa878f31cd1706cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f956d4d27437c830871f6634a3018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:38.220671 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-2fe8fc83-b612-463c-819e-7dd31c5b2f9c tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] 10.222.0.61 "GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8" status: 200 len: 1258 microversion: 2.1 time: 0.098748 Aug 27 02:23:38.225451 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 189/381] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:23:38 2022] GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8 => generated 1258 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:23:38.861041 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-d313b061-e0b5-4e0d-9986-3bc548527aca tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:38.861769 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-d313b061-e0b5-4e0d-9986-3bc548527aca tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:38.864396 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=1 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:23:38.871045 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d313b061-e0b5-4e0d-9986-3bc548527aca tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:38.871602 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d313b061-e0b5-4e0d-9986-3bc548527aca tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:38.872130 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d313b061-e0b5-4e0d-9986-3bc548527aca tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:38.872934 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d313b061-e0b5-4e0d-9986-3bc548527aca tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:38.873428 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d313b061-e0b5-4e0d-9986-3bc548527aca tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:38.873926 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d313b061-e0b5-4e0d-9986-3bc548527aca tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:39.032093 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-d313b061-e0b5-4e0d-9986-3bc548527aca tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:39.041359 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-d313b061-e0b5-4e0d-9986-3bc548527aca tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:39.043234 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-d313b061-e0b5-4e0d-9986-3bc548527aca tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:39.044744 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-d313b061-e0b5-4e0d-9986-3bc548527aca tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db" status: 200 len: 1720 microversion: 2.20 time: 0.189059 Aug 27 02:23:39.045618 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 193/382] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:23:38 2022] GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db => generated 1720 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:23:39.247887 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-84d64c59-0a67-4867-8e93-dba466e256c2 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:39.248610 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-84d64c59-0a67-4867-8e93-dba466e256c2 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] [instance: 49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:39.256080 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-84d64c59-0a67-4867-8e93-dba466e256c2 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:39.256616 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-84d64c59-0a67-4867-8e93-dba466e256c2 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:39.257090 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-84d64c59-0a67-4867-8e93-dba466e256c2 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:39.257925 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-84d64c59-0a67-4867-8e93-dba466e256c2 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:39.258483 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-84d64c59-0a67-4867-8e93-dba466e256c2 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:39.258957 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-84d64c59-0a67-4867-8e93-dba466e256c2 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:39.356067 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-84d64c59-0a67-4867-8e93-dba466e256c2 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931dcabba0214e3daa878f31cd1706cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f956d4d27437c830871f6634a3018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:39.364394 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-84d64c59-0a67-4867-8e93-dba466e256c2 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] 10.222.0.61 "GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8" status: 200 len: 1262 microversion: 2.1 time: 0.121350 Aug 27 02:23:39.365107 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 190/383] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:23:39 2022] GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8 => generated 1262 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:23:40.086427 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-3a3c5afd-c0fb-4c26-b910-056aae1639f2 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:40.087488 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-3a3c5afd-c0fb-4c26-b910-056aae1639f2 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:40.098723 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3a3c5afd-c0fb-4c26-b910-056aae1639f2 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:40.099685 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3a3c5afd-c0fb-4c26-b910-056aae1639f2 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:40.100452 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3a3c5afd-c0fb-4c26-b910-056aae1639f2 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:40.101687 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3a3c5afd-c0fb-4c26-b910-056aae1639f2 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:40.102487 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3a3c5afd-c0fb-4c26-b910-056aae1639f2 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:40.103236 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3a3c5afd-c0fb-4c26-b910-056aae1639f2 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:40.109013 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:23:40.263412 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-3a3c5afd-c0fb-4c26-b910-056aae1639f2 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:40.273256 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-3a3c5afd-c0fb-4c26-b910-056aae1639f2 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:40.274727 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-3a3c5afd-c0fb-4c26-b910-056aae1639f2 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:40.276045 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-3a3c5afd-c0fb-4c26-b910-056aae1639f2 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db" status: 200 len: 1720 microversion: 2.20 time: 0.196159 Aug 27 02:23:40.276622 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 194/384] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:23:40 2022] GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db => generated 1720 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:23:40.402442 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-06851a95-36dd-4192-bd2e-107fbe796d4a tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:40.403437 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-06851a95-36dd-4192-bd2e-107fbe796d4a tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] [instance: 49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:40.411656 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-06851a95-36dd-4192-bd2e-107fbe796d4a tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:40.412153 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-06851a95-36dd-4192-bd2e-107fbe796d4a tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:40.412576 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-06851a95-36dd-4192-bd2e-107fbe796d4a tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:40.413284 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-06851a95-36dd-4192-bd2e-107fbe796d4a tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:40.413978 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-06851a95-36dd-4192-bd2e-107fbe796d4a tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:40.414162 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-06851a95-36dd-4192-bd2e-107fbe796d4a tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:40.523125 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-06851a95-36dd-4192-bd2e-107fbe796d4a tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931dcabba0214e3daa878f31cd1706cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f956d4d27437c830871f6634a3018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:40.532053 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-06851a95-36dd-4192-bd2e-107fbe796d4a tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] 10.222.0.61 "GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8" status: 200 len: 1262 microversion: 2.1 time: 0.137522 Aug 27 02:23:40.545746 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 191/385] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:23:40 2022] GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8 => generated 1262 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:23:41.302772 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-40a477bc-faef-46b6-922e-c2608a3d662d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:41.304034 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-40a477bc-faef-46b6-922e-c2608a3d662d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:41.313209 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-40a477bc-faef-46b6-922e-c2608a3d662d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:41.313757 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-40a477bc-faef-46b6-922e-c2608a3d662d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:41.314183 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-40a477bc-faef-46b6-922e-c2608a3d662d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:41.315248 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-40a477bc-faef-46b6-922e-c2608a3d662d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:41.315994 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-40a477bc-faef-46b6-922e-c2608a3d662d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:41.316750 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-40a477bc-faef-46b6-922e-c2608a3d662d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:41.500839 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [req-1497b821-2575-466a-8dc2-a25c76ee6375 req-7f245205-71b8-49d4-9554-6d86e90348fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47d706cc-4f9b-4d59-8eca-caae165ec5db", "name": "network-vif-unplugged", "status": "completed", "tag": "118e8d55-f026-4cab-95af-2825721ac127"}]} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:23:41.528376 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-1497b821-2575-466a-8dc2-a25c76ee6375 req-7f245205-71b8-49d4-9554-6d86e90348fc service nova] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:41.528869 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-1497b821-2575-466a-8dc2-a25c76ee6375 req-7f245205-71b8-49d4-9554-6d86e90348fc service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:41.529296 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-1497b821-2575-466a-8dc2-a25c76ee6375 req-7f245205-71b8-49d4-9554-6d86e90348fc service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:41.570482 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.compute.server_external_events [req-1497b821-2575-466a-8dc2-a25c76ee6375 req-7f245205-71b8-49d4-9554-6d86e90348fc service nova] Creating event network-vif-unplugged:118e8d55-f026-4cab-95af-2825721ac127 for instance 47d706cc-4f9b-4d59-8eca-caae165ec5db on hv-cinder-84630 Aug 27 02:23:41.591213 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [req-1497b821-2575-466a-8dc2-a25c76ee6375 req-7f245205-71b8-49d4-9554-6d86e90348fc service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.094023 Aug 27 02:23:41.591826 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 192/386] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Aug 27 02:23:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:23:41.597667 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-40a477bc-faef-46b6-922e-c2608a3d662d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:41.606904 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-2f3b443b-49af-4ccf-aa13-0929d06158e2 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:41.607662 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-2f3b443b-49af-4ccf-aa13-0929d06158e2 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] [instance: 49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:41.614583 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-40a477bc-faef-46b6-922e-c2608a3d662d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:41.616598 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-40a477bc-faef-46b6-922e-c2608a3d662d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:41.635685 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2f3b443b-49af-4ccf-aa13-0929d06158e2 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:41.635896 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-40a477bc-faef-46b6-922e-c2608a3d662d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db" status: 200 len: 1723 microversion: 2.20 time: 0.332002 Aug 27 02:23:41.635896 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 195/387] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:23:41 2022] GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db => generated 1723 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:23:41.636122 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2f3b443b-49af-4ccf-aa13-0929d06158e2 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:41.636122 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2f3b443b-49af-4ccf-aa13-0929d06158e2 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:41.636122 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2f3b443b-49af-4ccf-aa13-0929d06158e2 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:41.636122 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2f3b443b-49af-4ccf-aa13-0929d06158e2 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:41.636392 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2f3b443b-49af-4ccf-aa13-0929d06158e2 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:41.671043 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-0ba2b614-c18a-46eb-9da1-9100a13f1d0c tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "34216252-16ba-47d1-abc4-77b784e6b96c"}} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:23:41.673494 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-0ba2b614-c18a-46eb-9da1-9100a13f1d0c tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:41.679788 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0ba2b614-c18a-46eb-9da1-9100a13f1d0c tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:41.680268 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0ba2b614-c18a-46eb-9da1-9100a13f1d0c tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:41.680697 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0ba2b614-c18a-46eb-9da1-9100a13f1d0c tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:41.681441 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0ba2b614-c18a-46eb-9da1-9100a13f1d0c tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:41.681949 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0ba2b614-c18a-46eb-9da1-9100a13f1d0c tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:41.682634 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0ba2b614-c18a-46eb-9da1-9100a13f1d0c tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:41.721638 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-2f3b443b-49af-4ccf-aa13-0929d06158e2 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931dcabba0214e3daa878f31cd1706cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f956d4d27437c830871f6634a3018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:41.740562 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-2f3b443b-49af-4ccf-aa13-0929d06158e2 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] 10.222.0.61 "GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8" status: 200 len: 1310 microversion: 2.1 time: 0.135626 Aug 27 02:23:41.753750 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 193/388] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:23:41 2022] GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8 => generated 1310 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:23:42.030258 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-0ba2b614-c18a-46eb-9da1-9100a13f1d0c tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "POST /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.375679 Aug 27 02:23:42.031099 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 196/389] 10.222.0.61 () {62 vars in 1364 bytes} [Sat Aug 27 02:23:41 2022] POST /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db/os-volume_attachments => generated 188 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:23:42.169163 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-5eeb8de3-db06-4fff-a526-3577dc7d74aa tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:23:42.169771 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-5eeb8de3-db06-4fff-a526-3577dc7d74aa tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:42.176239 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5eeb8de3-db06-4fff-a526-3577dc7d74aa tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:42.176726 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5eeb8de3-db06-4fff-a526-3577dc7d74aa tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:42.177184 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5eeb8de3-db06-4fff-a526-3577dc7d74aa tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:42.177977 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5eeb8de3-db06-4fff-a526-3577dc7d74aa tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:42.178429 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5eeb8de3-db06-4fff-a526-3577dc7d74aa tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:42.178897 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5eeb8de3-db06-4fff-a526-3577dc7d74aa tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:42.229442 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-5eeb8de3-db06-4fff-a526-3577dc7d74aa tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120783) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 27 02:23:42.328047 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-5eeb8de3-db06-4fff-a526-3577dc7d74aa tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "POST /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db/action" status: 202 len: 0 microversion: 2.20 time: 0.162975 Aug 27 02:23:42.328766 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 194/390] 10.222.0.61 () {62 vars in 1319 bytes} [Sat Aug 27 02:23:42 2022] POST /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db/action => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:23:42.338918 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-964becd7-b3f2-4da8-b356-90c67aa8b550 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:42.339705 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-964becd7-b3f2-4da8-b356-90c67aa8b550 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:42.351379 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-964becd7-b3f2-4da8-b356-90c67aa8b550 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:42.352018 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-964becd7-b3f2-4da8-b356-90c67aa8b550 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:42.352753 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-964becd7-b3f2-4da8-b356-90c67aa8b550 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:42.353823 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-964becd7-b3f2-4da8-b356-90c67aa8b550 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:42.354467 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-964becd7-b3f2-4da8-b356-90c67aa8b550 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:42.355090 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-964becd7-b3f2-4da8-b356-90c67aa8b550 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:42.620394 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-964becd7-b3f2-4da8-b356-90c67aa8b550 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:42.648789 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-964becd7-b3f2-4da8-b356-90c67aa8b550 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:42.658283 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-964becd7-b3f2-4da8-b356-90c67aa8b550 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:42.662735 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-964becd7-b3f2-4da8-b356-90c67aa8b550 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db" status: 200 len: 1809 microversion: 2.20 time: 0.328442 Aug 27 02:23:42.664716 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 197/391] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:23:42 2022] GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db => generated 1809 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:23:42.765141 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-172633a3-0298-4467-9c1b-54e31dffaee2 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:42.767497 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-172633a3-0298-4467-9c1b-54e31dffaee2 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] [instance: 49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:42.781301 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-172633a3-0298-4467-9c1b-54e31dffaee2 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:42.782006 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-172633a3-0298-4467-9c1b-54e31dffaee2 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:42.783064 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-172633a3-0298-4467-9c1b-54e31dffaee2 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:42.784311 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-172633a3-0298-4467-9c1b-54e31dffaee2 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:42.785347 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-172633a3-0298-4467-9c1b-54e31dffaee2 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:42.786262 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-172633a3-0298-4467-9c1b-54e31dffaee2 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:42.829173 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-f393e4b2-b665-42eb-b336-5f291e2f97fe tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:42.834923 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-f393e4b2-b665-42eb-b336-5f291e2f97fe tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] [instance: 35d91cb7-f14b-4788-b503-ea9feaee650b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:42.862381 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f393e4b2-b665-42eb-b336-5f291e2f97fe tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:42.863588 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f393e4b2-b665-42eb-b336-5f291e2f97fe tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:42.864627 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f393e4b2-b665-42eb-b336-5f291e2f97fe tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:42.866056 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f393e4b2-b665-42eb-b336-5f291e2f97fe tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:42.867319 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f393e4b2-b665-42eb-b336-5f291e2f97fe tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:42.868349 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f393e4b2-b665-42eb-b336-5f291e2f97fe tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:42.895523 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-172633a3-0298-4467-9c1b-54e31dffaee2 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931dcabba0214e3daa878f31cd1706cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f956d4d27437c830871f6634a3018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:42.907439 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-172633a3-0298-4467-9c1b-54e31dffaee2 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] 10.222.0.61 "GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8" status: 200 len: 1318 microversion: 2.1 time: 0.150344 Aug 27 02:23:42.908257 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 195/392] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:23:42 2022] GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:23:42.985691 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-f393e4b2-b665-42eb-b336-5f291e2f97fe tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] [instance: 35d91cb7-f14b-4788-b503-ea9feaee650b] Going to try to terminate instance {{(pid=120782) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:23:43.159190 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-f393e4b2-b665-42eb-b336-5f291e2f97fe tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] 10.222.0.61 "DELETE /compute/v2.1/servers/35d91cb7-f14b-4788-b503-ea9feaee650b" status: 204 len: 0 microversion: 2.1 time: 0.336307 Aug 27 02:23:43.159782 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 198/393] 10.222.0.61 () {58 vars in 1239 bytes} [Sat Aug 27 02:23:42 2022] DELETE /compute/v2.1/servers/35d91cb7-f14b-4788-b503-ea9feaee650b => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:23:43.175216 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-84cce411-61f2-4cd8-aa7b-63ac91c6e6fc tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:43.178587 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-84cce411-61f2-4cd8-aa7b-63ac91c6e6fc tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] [instance: 35d91cb7-f14b-4788-b503-ea9feaee650b] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:43.186935 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-84cce411-61f2-4cd8-aa7b-63ac91c6e6fc tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:43.187989 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-84cce411-61f2-4cd8-aa7b-63ac91c6e6fc tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:43.188584 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-84cce411-61f2-4cd8-aa7b-63ac91c6e6fc tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:43.189485 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-84cce411-61f2-4cd8-aa7b-63ac91c6e6fc tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:43.190120 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-84cce411-61f2-4cd8-aa7b-63ac91c6e6fc tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:43.197829 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-84cce411-61f2-4cd8-aa7b-63ac91c6e6fc tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:43.447891 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-84cce411-61f2-4cd8-aa7b-63ac91c6e6fc tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f931e726872474dae2b7b6fbb0eb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7bf59244bc487b84c7dbf9aa7314d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:43.467317 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-84cce411-61f2-4cd8-aa7b-63ac91c6e6fc tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] 10.222.0.61 "GET /compute/v2.1/servers/35d91cb7-f14b-4788-b503-ea9feaee650b" status: 200 len: 1514 microversion: 2.1 time: 0.299499 Aug 27 02:23:43.468286 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 196/394] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:23:43 2022] GET /compute/v2.1/servers/35d91cb7-f14b-4788-b503-ea9feaee650b => generated 1514 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:23:43.712931 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-0b63e4f3-f858-4a7b-a3b5-4a472bc7a274 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:43.714660 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-0b63e4f3-f858-4a7b-a3b5-4a472bc7a274 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:43.726107 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0b63e4f3-f858-4a7b-a3b5-4a472bc7a274 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:43.727052 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0b63e4f3-f858-4a7b-a3b5-4a472bc7a274 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:43.727878 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0b63e4f3-f858-4a7b-a3b5-4a472bc7a274 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:43.729548 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0b63e4f3-f858-4a7b-a3b5-4a472bc7a274 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:43.730346 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0b63e4f3-f858-4a7b-a3b5-4a472bc7a274 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:43.731196 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0b63e4f3-f858-4a7b-a3b5-4a472bc7a274 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:43.732356 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell0:SELECT=6 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:23:43.948659 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-6df046e4-c9a1-450b-ab7f-c4a7d54e4eaa tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:43.949549 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-6df046e4-c9a1-450b-ab7f-c4a7d54e4eaa tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] [instance: 49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:43.960962 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6df046e4-c9a1-450b-ab7f-c4a7d54e4eaa tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:43.963652 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6df046e4-c9a1-450b-ab7f-c4a7d54e4eaa tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:43.965306 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6df046e4-c9a1-450b-ab7f-c4a7d54e4eaa tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:43.967818 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6df046e4-c9a1-450b-ab7f-c4a7d54e4eaa tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:43.970390 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6df046e4-c9a1-450b-ab7f-c4a7d54e4eaa tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:43.980746 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6df046e4-c9a1-450b-ab7f-c4a7d54e4eaa tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:44.094256 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-0b63e4f3-f858-4a7b-a3b5-4a472bc7a274 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:44.105161 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-0b63e4f3-f858-4a7b-a3b5-4a472bc7a274 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:44.108329 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-0b63e4f3-f858-4a7b-a3b5-4a472bc7a274 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:44.110052 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-0b63e4f3-f858-4a7b-a3b5-4a472bc7a274 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db" status: 200 len: 1749 microversion: 2.20 time: 0.405363 Aug 27 02:23:44.110842 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 199/395] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:23:43 2022] GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db => generated 1749 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:23:44.213962 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-6df046e4-c9a1-450b-ab7f-c4a7d54e4eaa tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931dcabba0214e3daa878f31cd1706cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f956d4d27437c830871f6634a3018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:44.223159 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-6df046e4-c9a1-450b-ab7f-c4a7d54e4eaa tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] 10.222.0.61 "GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8" status: 200 len: 1358 microversion: 2.1 time: 0.278104 Aug 27 02:23:44.224962 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 197/396] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:23:43 2022] GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8 => generated 1358 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:23:44.502733 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-4ccd8716-8bb0-4eb9-b30f-5e262cf0783a tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:44.503242 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-4ccd8716-8bb0-4eb9-b30f-5e262cf0783a tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] [instance: 35d91cb7-f14b-4788-b503-ea9feaee650b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:44.510348 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4ccd8716-8bb0-4eb9-b30f-5e262cf0783a tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:44.510846 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4ccd8716-8bb0-4eb9-b30f-5e262cf0783a tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:44.511281 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4ccd8716-8bb0-4eb9-b30f-5e262cf0783a tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:44.512011 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4ccd8716-8bb0-4eb9-b30f-5e262cf0783a tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:44.512462 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4ccd8716-8bb0-4eb9-b30f-5e262cf0783a tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:44.512888 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4ccd8716-8bb0-4eb9-b30f-5e262cf0783a tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:44.666615 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-4ccd8716-8bb0-4eb9-b30f-5e262cf0783a tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f931e726872474dae2b7b6fbb0eb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7bf59244bc487b84c7dbf9aa7314d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:44.676869 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-4ccd8716-8bb0-4eb9-b30f-5e262cf0783a tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] 10.222.0.61 "GET /compute/v2.1/servers/35d91cb7-f14b-4788-b503-ea9feaee650b" status: 200 len: 1514 microversion: 2.1 time: 0.178120 Aug 27 02:23:44.677666 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 200/397] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:23:44 2022] GET /compute/v2.1/servers/35d91cb7-f14b-4788-b503-ea9feaee650b => generated 1514 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:23:45.135884 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-429e94b4-3d9e-405a-ace1-1b7d86a7d0df tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:45.136566 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-429e94b4-3d9e-405a-ace1-1b7d86a7d0df tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:45.143515 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-429e94b4-3d9e-405a-ace1-1b7d86a7d0df tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:45.144000 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-429e94b4-3d9e-405a-ace1-1b7d86a7d0df tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:45.144434 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-429e94b4-3d9e-405a-ace1-1b7d86a7d0df tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:45.145131 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-429e94b4-3d9e-405a-ace1-1b7d86a7d0df tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:45.145600 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-429e94b4-3d9e-405a-ace1-1b7d86a7d0df tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:45.146058 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-429e94b4-3d9e-405a-ace1-1b7d86a7d0df tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:45.244945 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-01648125-1772-43c2-9f26-32af43eb639c tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:45.245689 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-01648125-1772-43c2-9f26-32af43eb639c tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] [instance: 49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:45.254587 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-01648125-1772-43c2-9f26-32af43eb639c tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:45.255482 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-01648125-1772-43c2-9f26-32af43eb639c tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:45.256105 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-01648125-1772-43c2-9f26-32af43eb639c tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:45.257119 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-01648125-1772-43c2-9f26-32af43eb639c tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:45.257791 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-01648125-1772-43c2-9f26-32af43eb639c tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:45.258359 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-01648125-1772-43c2-9f26-32af43eb639c tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:45.316451 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-429e94b4-3d9e-405a-ace1-1b7d86a7d0df tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:45.329688 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-429e94b4-3d9e-405a-ace1-1b7d86a7d0df tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:45.331920 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-429e94b4-3d9e-405a-ace1-1b7d86a7d0df tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:45.333132 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-429e94b4-3d9e-405a-ace1-1b7d86a7d0df tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db" status: 200 len: 1749 microversion: 2.20 time: 0.201506 Aug 27 02:23:45.333852 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 198/398] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:23:45 2022] GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db => generated 1749 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:23:45.483089 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-01648125-1772-43c2-9f26-32af43eb639c tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931dcabba0214e3daa878f31cd1706cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f956d4d27437c830871f6634a3018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:45.494658 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-01648125-1772-43c2-9f26-32af43eb639c tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] 10.222.0.61 "GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8" status: 200 len: 1358 microversion: 2.1 time: 0.253415 Aug 27 02:23:45.495419 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 201/399] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:23:45 2022] GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8 => generated 1358 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:23:45.700468 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-38d3ac9b-308f-4d93-882e-270d92542c63 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:45.701296 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-38d3ac9b-308f-4d93-882e-270d92542c63 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] [instance: 35d91cb7-f14b-4788-b503-ea9feaee650b] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:45.710431 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-38d3ac9b-308f-4d93-882e-270d92542c63 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:45.710924 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-38d3ac9b-308f-4d93-882e-270d92542c63 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:45.711387 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-38d3ac9b-308f-4d93-882e-270d92542c63 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:45.712102 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-38d3ac9b-308f-4d93-882e-270d92542c63 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:45.712559 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-38d3ac9b-308f-4d93-882e-270d92542c63 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:45.713063 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-38d3ac9b-308f-4d93-882e-270d92542c63 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:45.865043 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-38d3ac9b-308f-4d93-882e-270d92542c63 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f931e726872474dae2b7b6fbb0eb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7bf59244bc487b84c7dbf9aa7314d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:45.874891 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-38d3ac9b-308f-4d93-882e-270d92542c63 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] 10.222.0.61 "GET /compute/v2.1/servers/35d91cb7-f14b-4788-b503-ea9feaee650b" status: 200 len: 1514 microversion: 2.1 time: 0.179797 Aug 27 02:23:45.875623 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 199/400] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:23:45 2022] GET /compute/v2.1/servers/35d91cb7-f14b-4788-b503-ea9feaee650b => generated 1514 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:23:46.360327 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-a82244c3-5c52-42b2-9668-6c69204d4308 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:46.361364 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-a82244c3-5c52-42b2-9668-6c69204d4308 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:46.372462 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a82244c3-5c52-42b2-9668-6c69204d4308 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:46.373273 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a82244c3-5c52-42b2-9668-6c69204d4308 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:46.374049 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a82244c3-5c52-42b2-9668-6c69204d4308 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:46.375247 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a82244c3-5c52-42b2-9668-6c69204d4308 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:46.376027 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a82244c3-5c52-42b2-9668-6c69204d4308 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:46.376777 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a82244c3-5c52-42b2-9668-6c69204d4308 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:46.521037 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-6be9c8b0-0a8c-4c70-9b28-979e06b4d467 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:46.521895 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-6be9c8b0-0a8c-4c70-9b28-979e06b4d467 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] [instance: 49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:46.527964 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:23:46.533831 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6be9c8b0-0a8c-4c70-9b28-979e06b4d467 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:46.534533 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6be9c8b0-0a8c-4c70-9b28-979e06b4d467 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:46.535053 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6be9c8b0-0a8c-4c70-9b28-979e06b4d467 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:46.535994 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6be9c8b0-0a8c-4c70-9b28-979e06b4d467 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:46.536940 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6be9c8b0-0a8c-4c70-9b28-979e06b4d467 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:46.537646 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6be9c8b0-0a8c-4c70-9b28-979e06b4d467 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:46.551370 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-a82244c3-5c52-42b2-9668-6c69204d4308 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:46.567607 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-a82244c3-5c52-42b2-9668-6c69204d4308 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:46.570284 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-a82244c3-5c52-42b2-9668-6c69204d4308 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:46.572335 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-a82244c3-5c52-42b2-9668-6c69204d4308 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db" status: 200 len: 1749 microversion: 2.20 time: 0.217911 Aug 27 02:23:46.573283 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 202/401] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:23:46 2022] GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db => generated 1749 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:23:46.708445 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-6be9c8b0-0a8c-4c70-9b28-979e06b4d467 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931dcabba0214e3daa878f31cd1706cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f956d4d27437c830871f6634a3018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:46.717728 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-6be9c8b0-0a8c-4c70-9b28-979e06b4d467 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] 10.222.0.61 "GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8" status: 200 len: 1358 microversion: 2.1 time: 0.203994 Aug 27 02:23:46.718431 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 200/402] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:23:46 2022] GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8 => generated 1358 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:23:46.898841 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-59c1a7f5-23ff-43c9-af02-59c49d3ff21b tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:46.899461 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-59c1a7f5-23ff-43c9-af02-59c49d3ff21b tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] [instance: 35d91cb7-f14b-4788-b503-ea9feaee650b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:46.906936 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-59c1a7f5-23ff-43c9-af02-59c49d3ff21b tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:46.907713 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-59c1a7f5-23ff-43c9-af02-59c49d3ff21b tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:46.907998 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-59c1a7f5-23ff-43c9-af02-59c49d3ff21b tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:46.908977 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-59c1a7f5-23ff-43c9-af02-59c49d3ff21b tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:46.909766 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-59c1a7f5-23ff-43c9-af02-59c49d3ff21b tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:46.910423 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-59c1a7f5-23ff-43c9-af02-59c49d3ff21b tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:47.125654 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-59c1a7f5-23ff-43c9-af02-59c49d3ff21b tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f931e726872474dae2b7b6fbb0eb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7bf59244bc487b84c7dbf9aa7314d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:47.134720 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-59c1a7f5-23ff-43c9-af02-59c49d3ff21b tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] 10.222.0.61 "GET /compute/v2.1/servers/35d91cb7-f14b-4788-b503-ea9feaee650b" status: 200 len: 1514 microversion: 2.1 time: 0.240720 Aug 27 02:23:47.135311 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 203/403] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:23:46 2022] GET /compute/v2.1/servers/35d91cb7-f14b-4788-b503-ea9feaee650b => generated 1514 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:23:47.604261 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-c6392eef-7b63-4c69-b364-ff5e147fb5da tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:47.605084 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-c6392eef-7b63-4c69-b364-ff5e147fb5da tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:47.613174 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c6392eef-7b63-4c69-b364-ff5e147fb5da tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:47.613724 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c6392eef-7b63-4c69-b364-ff5e147fb5da tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:47.614322 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c6392eef-7b63-4c69-b364-ff5e147fb5da tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:47.615197 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c6392eef-7b63-4c69-b364-ff5e147fb5da tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:47.615868 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c6392eef-7b63-4c69-b364-ff5e147fb5da tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:47.616507 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c6392eef-7b63-4c69-b364-ff5e147fb5da tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:47.751759 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-046c4b75-a6f3-4c47-b71f-24f55563a29a tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:47.753303 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-046c4b75-a6f3-4c47-b71f-24f55563a29a tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] [instance: 49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:47.765684 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-046c4b75-a6f3-4c47-b71f-24f55563a29a tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:47.766670 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-046c4b75-a6f3-4c47-b71f-24f55563a29a tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:47.767304 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-046c4b75-a6f3-4c47-b71f-24f55563a29a tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:47.768079 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-046c4b75-a6f3-4c47-b71f-24f55563a29a tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:47.768587 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-046c4b75-a6f3-4c47-b71f-24f55563a29a tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:47.769087 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-046c4b75-a6f3-4c47-b71f-24f55563a29a tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:47.793144 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-c6392eef-7b63-4c69-b364-ff5e147fb5da tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:47.803184 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-c6392eef-7b63-4c69-b364-ff5e147fb5da tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:47.804672 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-c6392eef-7b63-4c69-b364-ff5e147fb5da tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:47.806169 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-c6392eef-7b63-4c69-b364-ff5e147fb5da tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db" status: 200 len: 1749 microversion: 2.20 time: 0.208679 Aug 27 02:23:47.807463 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 201/404] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:23:47 2022] GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db => generated 1749 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:23:47.940252 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-046c4b75-a6f3-4c47-b71f-24f55563a29a tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931dcabba0214e3daa878f31cd1706cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f956d4d27437c830871f6634a3018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:47.951111 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-046c4b75-a6f3-4c47-b71f-24f55563a29a tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] 10.222.0.61 "GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8" status: 200 len: 1358 microversion: 2.1 time: 0.206796 Aug 27 02:23:47.951895 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 204/405] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:23:47 2022] GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8 => generated 1358 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:23:48.156613 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-c748cbec-6a71-4833-b1af-358881396e52 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:48.157132 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-c748cbec-6a71-4833-b1af-358881396e52 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] [instance: 35d91cb7-f14b-4788-b503-ea9feaee650b] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:48.159116 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell0:SELECT=2 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:23:48.166941 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c748cbec-6a71-4833-b1af-358881396e52 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:48.167455 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c748cbec-6a71-4833-b1af-358881396e52 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:48.167951 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c748cbec-6a71-4833-b1af-358881396e52 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:48.168592 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c748cbec-6a71-4833-b1af-358881396e52 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:48.169048 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c748cbec-6a71-4833-b1af-358881396e52 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:48.169525 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c748cbec-6a71-4833-b1af-358881396e52 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:48.217878 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell0:SELECT=12 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:23:48.331138 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-c748cbec-6a71-4833-b1af-358881396e52 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f931e726872474dae2b7b6fbb0eb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7bf59244bc487b84c7dbf9aa7314d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:48.344975 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-c748cbec-6a71-4833-b1af-358881396e52 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] 10.222.0.61 "GET /compute/v2.1/servers/35d91cb7-f14b-4788-b503-ea9feaee650b" status: 200 len: 1514 microversion: 2.1 time: 0.191927 Aug 27 02:23:48.346049 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 202/406] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:23:48 2022] GET /compute/v2.1/servers/35d91cb7-f14b-4788-b503-ea9feaee650b => generated 1514 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:23:48.841759 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-54a921f1-4b7b-4c14-adca-abdfaf37842b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:48.842484 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-54a921f1-4b7b-4c14-adca-abdfaf37842b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:48.849657 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-54a921f1-4b7b-4c14-adca-abdfaf37842b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:48.850167 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-54a921f1-4b7b-4c14-adca-abdfaf37842b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:48.850850 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-54a921f1-4b7b-4c14-adca-abdfaf37842b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:48.851550 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-54a921f1-4b7b-4c14-adca-abdfaf37842b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:48.851996 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-54a921f1-4b7b-4c14-adca-abdfaf37842b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:48.852646 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-54a921f1-4b7b-4c14-adca-abdfaf37842b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:48.972483 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-1186350e-64a0-4911-8b6f-2899d2d54bc5 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:48.973385 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-1186350e-64a0-4911-8b6f-2899d2d54bc5 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] [instance: 49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:48.980261 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1186350e-64a0-4911-8b6f-2899d2d54bc5 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:48.980760 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1186350e-64a0-4911-8b6f-2899d2d54bc5 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:48.981218 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1186350e-64a0-4911-8b6f-2899d2d54bc5 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:48.981951 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1186350e-64a0-4911-8b6f-2899d2d54bc5 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:48.982400 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1186350e-64a0-4911-8b6f-2899d2d54bc5 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:48.982826 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1186350e-64a0-4911-8b6f-2899d2d54bc5 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:49.087513 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-54a921f1-4b7b-4c14-adca-abdfaf37842b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:49.123933 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-54a921f1-4b7b-4c14-adca-abdfaf37842b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:49.126854 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-54a921f1-4b7b-4c14-adca-abdfaf37842b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:49.131079 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-54a921f1-4b7b-4c14-adca-abdfaf37842b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db" status: 200 len: 1749 microversion: 2.20 time: 0.293298 Aug 27 02:23:49.142037 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 205/407] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:23:48 2022] GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db => generated 1749 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:23:49.303679 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-1186350e-64a0-4911-8b6f-2899d2d54bc5 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931dcabba0214e3daa878f31cd1706cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f956d4d27437c830871f6634a3018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:49.315011 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-1186350e-64a0-4911-8b6f-2899d2d54bc5 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] 10.222.0.61 "GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8" status: 200 len: 1358 microversion: 2.1 time: 0.346300 Aug 27 02:23:49.316877 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 203/408] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:23:48 2022] GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8 => generated 1358 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:23:49.383919 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-732aa83e-ab03-4a53-bd7e-b1917fbbaecd tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:49.384959 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-732aa83e-ab03-4a53-bd7e-b1917fbbaecd tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] [instance: 35d91cb7-f14b-4788-b503-ea9feaee650b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:49.406817 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-732aa83e-ab03-4a53-bd7e-b1917fbbaecd tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:49.407903 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-732aa83e-ab03-4a53-bd7e-b1917fbbaecd tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:49.409673 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-732aa83e-ab03-4a53-bd7e-b1917fbbaecd tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:49.411379 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-732aa83e-ab03-4a53-bd7e-b1917fbbaecd tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:49.412358 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-732aa83e-ab03-4a53-bd7e-b1917fbbaecd tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:49.413285 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-732aa83e-ab03-4a53-bd7e-b1917fbbaecd tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:49.454615 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:23:49.892004 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-732aa83e-ab03-4a53-bd7e-b1917fbbaecd tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f931e726872474dae2b7b6fbb0eb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7bf59244bc487b84c7dbf9aa7314d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:49.907533 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-732aa83e-ab03-4a53-bd7e-b1917fbbaecd tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] 10.222.0.61 "GET /compute/v2.1/servers/35d91cb7-f14b-4788-b503-ea9feaee650b" status: 200 len: 1514 microversion: 2.1 time: 0.530494 Aug 27 02:23:49.909530 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 206/409] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:23:49 2022] GET /compute/v2.1/servers/35d91cb7-f14b-4788-b503-ea9feaee650b => generated 1514 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:23:50.186218 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-d4ed4602-880f-4ef2-a842-866b54b74a5d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:50.187560 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-d4ed4602-880f-4ef2-a842-866b54b74a5d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:50.215674 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d4ed4602-880f-4ef2-a842-866b54b74a5d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:50.217240 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d4ed4602-880f-4ef2-a842-866b54b74a5d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:50.221648 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d4ed4602-880f-4ef2-a842-866b54b74a5d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:50.223032 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d4ed4602-880f-4ef2-a842-866b54b74a5d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:50.223742 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d4ed4602-880f-4ef2-a842-866b54b74a5d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:50.224370 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d4ed4602-880f-4ef2-a842-866b54b74a5d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:50.358156 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-3197bf27-bcf0-422d-a8dd-39ebd66fb3ce tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:50.361469 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-3197bf27-bcf0-422d-a8dd-39ebd66fb3ce tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] [instance: 49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:50.380562 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3197bf27-bcf0-422d-a8dd-39ebd66fb3ce tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:50.382213 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3197bf27-bcf0-422d-a8dd-39ebd66fb3ce tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:50.383516 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3197bf27-bcf0-422d-a8dd-39ebd66fb3ce tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:50.385298 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3197bf27-bcf0-422d-a8dd-39ebd66fb3ce tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:50.389710 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3197bf27-bcf0-422d-a8dd-39ebd66fb3ce tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:50.390988 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3197bf27-bcf0-422d-a8dd-39ebd66fb3ce tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:50.561804 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-d4ed4602-880f-4ef2-a842-866b54b74a5d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:50.572975 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-d4ed4602-880f-4ef2-a842-866b54b74a5d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:50.575163 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-d4ed4602-880f-4ef2-a842-866b54b74a5d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:50.577198 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-d4ed4602-880f-4ef2-a842-866b54b74a5d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db" status: 200 len: 1751 microversion: 2.20 time: 0.396980 Aug 27 02:23:50.578367 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 204/410] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:23:50 2022] GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db => generated 1751 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:23:50.846072 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-3197bf27-bcf0-422d-a8dd-39ebd66fb3ce tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931dcabba0214e3daa878f31cd1706cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f956d4d27437c830871f6634a3018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:50.864491 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-3197bf27-bcf0-422d-a8dd-39ebd66fb3ce tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] 10.222.0.61 "GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8" status: 200 len: 1358 microversion: 2.1 time: 0.516494 Aug 27 02:23:50.877790 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 207/411] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:23:50 2022] GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8 => generated 1358 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:23:50.946482 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-72eb1fa4-a503-46b6-81d1-4c013242987e tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:50.947526 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-72eb1fa4-a503-46b6-81d1-4c013242987e tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] [instance: 35d91cb7-f14b-4788-b503-ea9feaee650b] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:50.956262 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-72eb1fa4-a503-46b6-81d1-4c013242987e tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:50.956767 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-72eb1fa4-a503-46b6-81d1-4c013242987e tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:50.958592 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-72eb1fa4-a503-46b6-81d1-4c013242987e tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:50.962122 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-72eb1fa4-a503-46b6-81d1-4c013242987e tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:50.963835 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-72eb1fa4-a503-46b6-81d1-4c013242987e tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:50.964881 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-72eb1fa4-a503-46b6-81d1-4c013242987e tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:50.972468 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [req-d64b5be8-9b70-404e-ab26-d0cbf9f92385 req-eea99dca-66da-4864-a1a7-e5dc557e13ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8", "tag": "d60d4774-8401-4c3b-b403-1555799f9a3f"}]} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:23:50.977563 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:23:50.999497 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-d64b5be8-9b70-404e-ab26-d0cbf9f92385 req-eea99dca-66da-4864-a1a7-e5dc557e13ec service nova] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:50.999992 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-d64b5be8-9b70-404e-ab26-d0cbf9f92385 req-eea99dca-66da-4864-a1a7-e5dc557e13ec service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:51.000553 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-d64b5be8-9b70-404e-ab26-d0cbf9f92385 req-eea99dca-66da-4864-a1a7-e5dc557e13ec service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:51.034484 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.compute.server_external_events [req-d64b5be8-9b70-404e-ab26-d0cbf9f92385 req-eea99dca-66da-4864-a1a7-e5dc557e13ec service nova] Creating event network-changed:d60d4774-8401-4c3b-b403-1555799f9a3f for instance 49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8 on hv-cinder-84630 Aug 27 02:23:51.049233 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [req-d64b5be8-9b70-404e-ab26-d0cbf9f92385 req-eea99dca-66da-4864-a1a7-e5dc557e13ec service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075528 Aug 27 02:23:51.049233 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 208/412] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Aug 27 02:23:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:23:51.097207 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-72eb1fa4-a503-46b6-81d1-4c013242987e tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f931e726872474dae2b7b6fbb0eb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7bf59244bc487b84c7dbf9aa7314d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:51.108611 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-72eb1fa4-a503-46b6-81d1-4c013242987e tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] 10.222.0.61 "GET /compute/v2.1/servers/35d91cb7-f14b-4788-b503-ea9feaee650b" status: 200 len: 1472 microversion: 2.1 time: 0.169500 Aug 27 02:23:51.109582 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 205/413] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:23:50 2022] GET /compute/v2.1/servers/35d91cb7-f14b-4788-b503-ea9feaee650b => generated 1472 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:23:51.610688 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-3fef0e8a-7505-4575-bcaf-ff8b31316653 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:51.612649 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-3fef0e8a-7505-4575-bcaf-ff8b31316653 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:51.626478 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3fef0e8a-7505-4575-bcaf-ff8b31316653 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:51.627711 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3fef0e8a-7505-4575-bcaf-ff8b31316653 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:51.628507 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3fef0e8a-7505-4575-bcaf-ff8b31316653 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:51.630062 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3fef0e8a-7505-4575-bcaf-ff8b31316653 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:51.630879 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3fef0e8a-7505-4575-bcaf-ff8b31316653 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:51.631596 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3fef0e8a-7505-4575-bcaf-ff8b31316653 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:51.835405 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-3fef0e8a-7505-4575-bcaf-ff8b31316653 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:51.845332 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-3fef0e8a-7505-4575-bcaf-ff8b31316653 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:51.846816 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-3fef0e8a-7505-4575-bcaf-ff8b31316653 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:51.848002 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-3fef0e8a-7505-4575-bcaf-ff8b31316653 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db" status: 200 len: 1751 microversion: 2.20 time: 0.245947 Aug 27 02:23:51.848575 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 209/414] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:23:51 2022] GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db => generated 1751 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:23:51.905156 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-7e0ce3a5-6c38-4a58-bec6-bc8f41ea2fd9 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:51.918637 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-7e0ce3a5-6c38-4a58-bec6-bc8f41ea2fd9 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] [instance: 49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:51.930441 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7e0ce3a5-6c38-4a58-bec6-bc8f41ea2fd9 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:51.931668 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7e0ce3a5-6c38-4a58-bec6-bc8f41ea2fd9 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:51.932669 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7e0ce3a5-6c38-4a58-bec6-bc8f41ea2fd9 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:51.934062 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7e0ce3a5-6c38-4a58-bec6-bc8f41ea2fd9 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:51.934879 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7e0ce3a5-6c38-4a58-bec6-bc8f41ea2fd9 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:51.935641 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7e0ce3a5-6c38-4a58-bec6-bc8f41ea2fd9 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:52.132475 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-7e0ce3a5-6c38-4a58-bec6-bc8f41ea2fd9 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931dcabba0214e3daa878f31cd1706cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f956d4d27437c830871f6634a3018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:52.137136 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-3e68514e-f20f-44ce-8b03-fccb553f0a29 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:52.137870 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-3e68514e-f20f-44ce-8b03-fccb553f0a29 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] [instance: 35d91cb7-f14b-4788-b503-ea9feaee650b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:52.143513 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-7e0ce3a5-6c38-4a58-bec6-bc8f41ea2fd9 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] 10.222.0.61 "GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8" status: 200 len: 1358 microversion: 2.1 time: 0.245571 Aug 27 02:23:52.145193 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 206/415] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:23:51 2022] GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8 => generated 1358 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:23:52.145695 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3e68514e-f20f-44ce-8b03-fccb553f0a29 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:52.146244 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3e68514e-f20f-44ce-8b03-fccb553f0a29 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:52.146652 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3e68514e-f20f-44ce-8b03-fccb553f0a29 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:52.147341 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3e68514e-f20f-44ce-8b03-fccb553f0a29 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:52.147798 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3e68514e-f20f-44ce-8b03-fccb553f0a29 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:52.148228 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3e68514e-f20f-44ce-8b03-fccb553f0a29 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:52.254212 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-3e68514e-f20f-44ce-8b03-fccb553f0a29 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f931e726872474dae2b7b6fbb0eb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7bf59244bc487b84c7dbf9aa7314d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:52.263152 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-3e68514e-f20f-44ce-8b03-fccb553f0a29 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] 10.222.0.61 "GET /compute/v2.1/servers/35d91cb7-f14b-4788-b503-ea9feaee650b" status: 200 len: 1472 microversion: 2.1 time: 0.130049 Aug 27 02:23:52.264534 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 210/416] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:23:52 2022] GET /compute/v2.1/servers/35d91cb7-f14b-4788-b503-ea9feaee650b => generated 1472 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:23:52.578491 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-c7b1fa8b-bf2f-4570-84af-1ec789367b65 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1310327431", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1212741542", "security_groups": [{"name": "tempest-secgroup-smoke-651209214"}], "networks": [{"uuid": "f4046609-3c5c-4d1f-8162-4985f06371e2"}], "block_device_mapping_v2": [{"uuid": "c8d2de3f-4afd-43ba-a424-749f8f8f6b48", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:23:52.755241 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.network.neutron [None req-c7b1fa8b-bf2f-4570-84af-1ec789367b65 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] validate_networks() for [('f4046609-3c5c-4d1f-8162-4985f06371e2', None, None, None, None, None)] {{(pid=120783) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:23:52.887850 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-96d70942-aa61-4451-a7ed-d80f49dc12b2 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:52.888621 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-96d70942-aa61-4451-a7ed-d80f49dc12b2 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:52.898107 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-96d70942-aa61-4451-a7ed-d80f49dc12b2 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:52.899079 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-96d70942-aa61-4451-a7ed-d80f49dc12b2 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:52.899952 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-96d70942-aa61-4451-a7ed-d80f49dc12b2 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:52.901260 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-96d70942-aa61-4451-a7ed-d80f49dc12b2 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:52.902206 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-96d70942-aa61-4451-a7ed-d80f49dc12b2 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:52.903145 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-96d70942-aa61-4451-a7ed-d80f49dc12b2 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:53.221240 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-96d70942-aa61-4451-a7ed-d80f49dc12b2 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:53.235358 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-96d70942-aa61-4451-a7ed-d80f49dc12b2 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:53.239912 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-96d70942-aa61-4451-a7ed-d80f49dc12b2 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:53.243488 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-96d70942-aa61-4451-a7ed-d80f49dc12b2 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db" status: 200 len: 1751 microversion: 2.20 time: 0.360265 Aug 27 02:23:53.246703 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 211/417] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:23:52 2022] GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db => generated 1751 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:23:53.254467 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [req-03a6e755-5020-429f-978c-15bc30f7b653 req-d73c3fc4-e0a0-4d2f-b77b-8b597b57ce74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35d91cb7-f14b-4788-b503-ea9feaee650b", "name": "network-vif-deleted", "tag": "09c1cd32-b4a2-4973-8cda-7a230514db53"}]} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:23:53.275417 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-03a6e755-5020-429f-978c-15bc30f7b653 req-d73c3fc4-e0a0-4d2f-b77b-8b597b57ce74 service nova] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:53.278217 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-03a6e755-5020-429f-978c-15bc30f7b653 req-d73c3fc4-e0a0-4d2f-b77b-8b597b57ce74 service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:53.278783 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-03a6e755-5020-429f-978c-15bc30f7b653 req-d73c3fc4-e0a0-4d2f-b77b-8b597b57ce74 service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:53.294208 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.compute.server_external_events [req-03a6e755-5020-429f-978c-15bc30f7b653 req-d73c3fc4-e0a0-4d2f-b77b-8b597b57ce74 service nova] Creating event network-vif-deleted:09c1cd32-b4a2-4973-8cda-7a230514db53 for instance 35d91cb7-f14b-4788-b503-ea9feaee650b on hv-cinder-84630 Aug 27 02:23:53.302792 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [req-03a6e755-5020-429f-978c-15bc30f7b653 req-d73c3fc4-e0a0-4d2f-b77b-8b597b57ce74 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051705 Aug 27 02:23:53.303760 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 212/418] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Aug 27 02:23:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:23:53.314874 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-e13700f7-4352-49f9-ba9c-0ce37318fe5e tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:53.314874 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-e13700f7-4352-49f9-ba9c-0ce37318fe5e tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] [instance: 49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:53.334611 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e13700f7-4352-49f9-ba9c-0ce37318fe5e tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:53.336200 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e13700f7-4352-49f9-ba9c-0ce37318fe5e tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:53.337469 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e13700f7-4352-49f9-ba9c-0ce37318fe5e tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:53.338741 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e13700f7-4352-49f9-ba9c-0ce37318fe5e tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:53.339800 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e13700f7-4352-49f9-ba9c-0ce37318fe5e tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:53.340908 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e13700f7-4352-49f9-ba9c-0ce37318fe5e tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:53.483813 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.virt.hardware [None req-c7b1fa8b-bf2f-4570-84af-1ec789367b65 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Flavor limits 0:0:0 {{(pid=120783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:23:53.484719 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.virt.hardware [None req-c7b1fa8b-bf2f-4570-84af-1ec789367b65 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Image limits 0:0:0 {{(pid=120783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:23:53.485650 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.virt.hardware [None req-c7b1fa8b-bf2f-4570-84af-1ec789367b65 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Flavor pref 0:0:0 {{(pid=120783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:23:53.486471 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.virt.hardware [None req-c7b1fa8b-bf2f-4570-84af-1ec789367b65 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Image pref 0:0:0 {{(pid=120783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:23:53.487316 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.virt.hardware [None req-c7b1fa8b-bf2f-4570-84af-1ec789367b65 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:23:53.505954 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c7b1fa8b-bf2f-4570-84af-1ec789367b65 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:53.506951 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c7b1fa8b-bf2f-4570-84af-1ec789367b65 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:53.507817 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c7b1fa8b-bf2f-4570-84af-1ec789367b65 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:53.509498 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c7b1fa8b-bf2f-4570-84af-1ec789367b65 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:53.510456 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c7b1fa8b-bf2f-4570-84af-1ec789367b65 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:53.511290 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c7b1fa8b-bf2f-4570-84af-1ec789367b65 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:53.546960 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.quota [None req-c7b1fa8b-bf2f-4570-84af-1ec789367b65 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Getting quotas for project fd2d4ae1c228446eb5bfc64d44348fdf. Resources: {'instances', 'ram', 'cores'} {{(pid=120783) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:23:53.554602 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.quota [None req-c7b1fa8b-bf2f-4570-84af-1ec789367b65 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Getting quotas for user ef7f53d57f3544e5a25e1beeddab9af4 and project fd2d4ae1c228446eb5bfc64d44348fdf. Resources: {'instances', 'ram', 'cores'} {{(pid=120783) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:23:53.632485 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-c7b1fa8b-bf2f-4570-84af-1ec789367b65 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Going to run 1 instances... {{(pid=120783) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:23:53.635773 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-c7b1fa8b-bf2f-4570-84af-1ec789367b65 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] [instance: 9fb59350-4f09-4e20-bddb-ffc9a65897b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c8d2de3f-4afd-43ba-a424-749f8f8f6b48',volume_size=None,volume_type=None)] {{(pid=120783) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:23:53.673197 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-e13700f7-4352-49f9-ba9c-0ce37318fe5e tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931dcabba0214e3daa878f31cd1706cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f956d4d27437c830871f6634a3018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:53.694279 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-e13700f7-4352-49f9-ba9c-0ce37318fe5e tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] 10.222.0.61 "GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8" status: 200 len: 1358 microversion: 2.1 time: 0.387024 Aug 27 02:23:53.699119 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 213/419] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:23:53 2022] GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8 => generated 1358 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:23:53.709315 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-b13e188b-51e7-4e75-8b0e-e2767727fdd5 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:53.725434 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-b13e188b-51e7-4e75-8b0e-e2767727fdd5 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] [instance: 35d91cb7-f14b-4788-b503-ea9feaee650b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:53.728296 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b13e188b-51e7-4e75-8b0e-e2767727fdd5 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:53.729173 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b13e188b-51e7-4e75-8b0e-e2767727fdd5 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:53.730012 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b13e188b-51e7-4e75-8b0e-e2767727fdd5 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:53.731337 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b13e188b-51e7-4e75-8b0e-e2767727fdd5 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:53.732173 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b13e188b-51e7-4e75-8b0e-e2767727fdd5 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:53.732918 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b13e188b-51e7-4e75-8b0e-e2767727fdd5 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:53.876094 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-b13e188b-51e7-4e75-8b0e-e2767727fdd5 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f931e726872474dae2b7b6fbb0eb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7bf59244bc487b84c7dbf9aa7314d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:53.903345 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-b13e188b-51e7-4e75-8b0e-e2767727fdd5 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] 10.222.0.61 "GET /compute/v2.1/servers/35d91cb7-f14b-4788-b503-ea9feaee650b" status: 200 len: 1472 microversion: 2.1 time: 0.199606 Aug 27 02:23:53.921506 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 214/420] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:23:53 2022] GET /compute/v2.1/servers/35d91cb7-f14b-4788-b503-ea9feaee650b => generated 1472 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:23:53.993281 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-c7b1fa8b-bf2f-4570-84af-1ec789367b65 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.419195 Aug 27 02:23:53.996885 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 207/421] 10.222.0.61 () {60 vars in 1147 bytes} [Sat Aug 27 02:23:52 2022] POST /compute/v2.1/servers => generated 405 bytes in 1424 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:23:54.009758 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-24ecde5c-53d9-4b0b-a65a-2d0ddb038ad6 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:54.022399 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-24ecde5c-53d9-4b0b-a65a-2d0ddb038ad6 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] [instance: 9fb59350-4f09-4e20-bddb-ffc9a65897b3] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:54.158354 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-24ecde5c-53d9-4b0b-a65a-2d0ddb038ad6 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f53d57f3544e5a25e1beeddab9af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2d4ae1c228446eb5bfc64d44348fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:54.167395 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-24ecde5c-53d9-4b0b-a65a-2d0ddb038ad6 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] 10.222.0.61 "GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3" status: 200 len: 1089 microversion: 2.1 time: 0.162702 Aug 27 02:23:54.182674 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 215/422] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:23:54 2022] GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3 => generated 1089 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:23:54.271120 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-f55baaeb-5b59-4a80-81c7-64a684d4facc tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:54.272459 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-f55baaeb-5b59-4a80-81c7-64a684d4facc tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:54.286443 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f55baaeb-5b59-4a80-81c7-64a684d4facc tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:54.287315 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f55baaeb-5b59-4a80-81c7-64a684d4facc tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:54.288642 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f55baaeb-5b59-4a80-81c7-64a684d4facc tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:54.290265 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f55baaeb-5b59-4a80-81c7-64a684d4facc tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:54.291264 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f55baaeb-5b59-4a80-81c7-64a684d4facc tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:54.292281 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f55baaeb-5b59-4a80-81c7-64a684d4facc tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:54.531261 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-f55baaeb-5b59-4a80-81c7-64a684d4facc tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:54.543958 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-f55baaeb-5b59-4a80-81c7-64a684d4facc tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:54.545935 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-f55baaeb-5b59-4a80-81c7-64a684d4facc tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:54.547766 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-f55baaeb-5b59-4a80-81c7-64a684d4facc tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db" status: 200 len: 1751 microversion: 2.20 time: 0.281116 Aug 27 02:23:54.548483 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 208/423] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:23:54 2022] GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db => generated 1751 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:23:54.736109 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-1d161020-65d7-4170-a6d5-d0b82bce40e1 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:54.737081 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-1d161020-65d7-4170-a6d5-d0b82bce40e1 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] [instance: 49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:54.745225 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1d161020-65d7-4170-a6d5-d0b82bce40e1 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:54.745746 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1d161020-65d7-4170-a6d5-d0b82bce40e1 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:54.746175 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1d161020-65d7-4170-a6d5-d0b82bce40e1 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:54.746871 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1d161020-65d7-4170-a6d5-d0b82bce40e1 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:54.747312 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1d161020-65d7-4170-a6d5-d0b82bce40e1 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:54.747741 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1d161020-65d7-4170-a6d5-d0b82bce40e1 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:54.948720 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-ca5c3492-b9f0-49b4-824e-6012fa786ade tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:54.949881 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-ca5c3492-b9f0-49b4-824e-6012fa786ade tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] [instance: 35d91cb7-f14b-4788-b503-ea9feaee650b] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:54.959681 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-1d161020-65d7-4170-a6d5-d0b82bce40e1 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931dcabba0214e3daa878f31cd1706cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f956d4d27437c830871f6634a3018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:54.963420 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ca5c3492-b9f0-49b4-824e-6012fa786ade tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:54.964441 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ca5c3492-b9f0-49b4-824e-6012fa786ade tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:54.965432 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ca5c3492-b9f0-49b4-824e-6012fa786ade tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:54.966775 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ca5c3492-b9f0-49b4-824e-6012fa786ade tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:54.967666 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ca5c3492-b9f0-49b4-824e-6012fa786ade tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:54.968564 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ca5c3492-b9f0-49b4-824e-6012fa786ade tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:54.971345 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-1d161020-65d7-4170-a6d5-d0b82bce40e1 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] 10.222.0.61 "GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8" status: 200 len: 1358 microversion: 2.1 time: 0.239470 Aug 27 02:23:54.972101 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 216/424] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:23:54 2022] GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8 => generated 1358 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:23:55.083988 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-ca5c3492-b9f0-49b4-824e-6012fa786ade tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f931e726872474dae2b7b6fbb0eb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7bf59244bc487b84c7dbf9aa7314d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:55.094335 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-ca5c3492-b9f0-49b4-824e-6012fa786ade tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] 10.222.0.61 "GET /compute/v2.1/servers/35d91cb7-f14b-4788-b503-ea9feaee650b" status: 200 len: 1472 microversion: 2.1 time: 0.152966 Aug 27 02:23:55.097774 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 209/425] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:23:54 2022] GET /compute/v2.1/servers/35d91cb7-f14b-4788-b503-ea9feaee650b => generated 1472 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:23:55.190449 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-16cf7632-15ae-4eb6-95b2-1a69ed38ab3d tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:55.191148 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-16cf7632-15ae-4eb6-95b2-1a69ed38ab3d tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] [instance: 9fb59350-4f09-4e20-bddb-ffc9a65897b3] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:55.198840 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-16cf7632-15ae-4eb6-95b2-1a69ed38ab3d tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:55.199361 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-16cf7632-15ae-4eb6-95b2-1a69ed38ab3d tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:55.199816 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-16cf7632-15ae-4eb6-95b2-1a69ed38ab3d tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:55.200504 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-16cf7632-15ae-4eb6-95b2-1a69ed38ab3d tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:55.200960 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-16cf7632-15ae-4eb6-95b2-1a69ed38ab3d tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:55.201382 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-16cf7632-15ae-4eb6-95b2-1a69ed38ab3d tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:55.307814 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-16cf7632-15ae-4eb6-95b2-1a69ed38ab3d tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f53d57f3544e5a25e1beeddab9af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2d4ae1c228446eb5bfc64d44348fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:55.330355 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-16cf7632-15ae-4eb6-95b2-1a69ed38ab3d tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] 10.222.0.61 "GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3" status: 200 len: 1139 microversion: 2.1 time: 0.143430 Aug 27 02:23:55.340761 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 217/426] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:23:55 2022] GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3 => generated 1139 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:23:55.576563 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-d79c7570-ab13-4a58-a739-6d6eb6e32b8b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:55.578045 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-d79c7570-ab13-4a58-a739-6d6eb6e32b8b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:55.584972 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d79c7570-ab13-4a58-a739-6d6eb6e32b8b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:55.585500 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d79c7570-ab13-4a58-a739-6d6eb6e32b8b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:55.585938 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d79c7570-ab13-4a58-a739-6d6eb6e32b8b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:55.586645 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d79c7570-ab13-4a58-a739-6d6eb6e32b8b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:55.587099 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d79c7570-ab13-4a58-a739-6d6eb6e32b8b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:55.587627 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d79c7570-ab13-4a58-a739-6d6eb6e32b8b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:55.793618 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-d79c7570-ab13-4a58-a739-6d6eb6e32b8b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:55.808331 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-d79c7570-ab13-4a58-a739-6d6eb6e32b8b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:55.810690 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-d79c7570-ab13-4a58-a739-6d6eb6e32b8b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:55.812775 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-d79c7570-ab13-4a58-a739-6d6eb6e32b8b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db" status: 200 len: 1751 microversion: 2.20 time: 0.242807 Aug 27 02:23:55.813774 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 210/427] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:23:55 2022] GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db => generated 1751 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:23:56.012521 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-f22db6eb-02b4-4b6a-b3f8-25c0d14265dc tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:56.014547 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-f22db6eb-02b4-4b6a-b3f8-25c0d14265dc tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] [instance: 49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:56.026128 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f22db6eb-02b4-4b6a-b3f8-25c0d14265dc tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:56.027397 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f22db6eb-02b4-4b6a-b3f8-25c0d14265dc tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:56.028554 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f22db6eb-02b4-4b6a-b3f8-25c0d14265dc tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:56.029737 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f22db6eb-02b4-4b6a-b3f8-25c0d14265dc tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:56.030432 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f22db6eb-02b4-4b6a-b3f8-25c0d14265dc tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:56.031142 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f22db6eb-02b4-4b6a-b3f8-25c0d14265dc tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:56.126310 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-085f6473-278b-453c-8417-a97c618fa3da tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:56.127910 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-085f6473-278b-453c-8417-a97c618fa3da tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] [instance: 35d91cb7-f14b-4788-b503-ea9feaee650b] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:56.148091 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-085f6473-278b-453c-8417-a97c618fa3da tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:56.148732 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-085f6473-278b-453c-8417-a97c618fa3da tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:56.149512 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-085f6473-278b-453c-8417-a97c618fa3da tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:56.150958 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-085f6473-278b-453c-8417-a97c618fa3da tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:56.151825 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-085f6473-278b-453c-8417-a97c618fa3da tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:56.152630 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-085f6473-278b-453c-8417-a97c618fa3da tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:56.273007 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-f22db6eb-02b4-4b6a-b3f8-25c0d14265dc tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931dcabba0214e3daa878f31cd1706cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f956d4d27437c830871f6634a3018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:56.282103 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-f22db6eb-02b4-4b6a-b3f8-25c0d14265dc tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] 10.222.0.61 "GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8" status: 200 len: 1358 microversion: 2.1 time: 0.276736 Aug 27 02:23:56.282944 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 218/428] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:23:56 2022] GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8 => generated 1358 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:23:56.293386 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-085f6473-278b-453c-8417-a97c618fa3da tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f931e726872474dae2b7b6fbb0eb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7bf59244bc487b84c7dbf9aa7314d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:56.308180 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-085f6473-278b-453c-8417-a97c618fa3da tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] 10.222.0.61 "GET /compute/v2.1/servers/35d91cb7-f14b-4788-b503-ea9feaee650b" status: 200 len: 1472 microversion: 2.1 time: 0.190025 Aug 27 02:23:56.309690 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 211/429] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:23:56 2022] GET /compute/v2.1/servers/35d91cb7-f14b-4788-b503-ea9feaee650b => generated 1472 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:23:56.356799 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-4e8b1ec4-ff7f-4418-8298-f178260a37c6 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:56.357938 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-4e8b1ec4-ff7f-4418-8298-f178260a37c6 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] [instance: 9fb59350-4f09-4e20-bddb-ffc9a65897b3] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:56.369074 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4e8b1ec4-ff7f-4418-8298-f178260a37c6 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:56.369968 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4e8b1ec4-ff7f-4418-8298-f178260a37c6 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:56.370692 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4e8b1ec4-ff7f-4418-8298-f178260a37c6 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:56.371899 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4e8b1ec4-ff7f-4418-8298-f178260a37c6 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:56.372688 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4e8b1ec4-ff7f-4418-8298-f178260a37c6 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:56.382666 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4e8b1ec4-ff7f-4418-8298-f178260a37c6 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:56.456859 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-4e8b1ec4-ff7f-4418-8298-f178260a37c6 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f53d57f3544e5a25e1beeddab9af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2d4ae1c228446eb5bfc64d44348fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:56.490619 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-4e8b1ec4-ff7f-4418-8298-f178260a37c6 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] 10.222.0.61 "GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3" status: 200 len: 1139 microversion: 2.1 time: 0.139909 Aug 27 02:23:56.493547 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 219/430] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:23:56 2022] GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3 => generated 1139 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:23:56.844548 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-cdb57d06-2d11-4a9b-8df3-f73c5141361e tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:56.846688 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-cdb57d06-2d11-4a9b-8df3-f73c5141361e tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:56.858836 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-cdb57d06-2d11-4a9b-8df3-f73c5141361e tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:56.860287 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-cdb57d06-2d11-4a9b-8df3-f73c5141361e tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:56.861364 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-cdb57d06-2d11-4a9b-8df3-f73c5141361e tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:56.863083 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-cdb57d06-2d11-4a9b-8df3-f73c5141361e tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:56.864596 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-cdb57d06-2d11-4a9b-8df3-f73c5141361e tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:56.865791 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-cdb57d06-2d11-4a9b-8df3-f73c5141361e tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:57.116023 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-cdb57d06-2d11-4a9b-8df3-f73c5141361e tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:57.134433 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-cdb57d06-2d11-4a9b-8df3-f73c5141361e tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:57.137932 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-cdb57d06-2d11-4a9b-8df3-f73c5141361e tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:57.140752 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-cdb57d06-2d11-4a9b-8df3-f73c5141361e tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db" status: 200 len: 1751 microversion: 2.20 time: 0.303483 Aug 27 02:23:57.142479 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 212/431] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:23:56 2022] GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db => generated 1751 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:23:57.322443 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-457a4c78-c421-425a-920f-5f041cfdb946 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:57.324056 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-457a4c78-c421-425a-920f-5f041cfdb946 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] [instance: 49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:57.331720 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-457a4c78-c421-425a-920f-5f041cfdb946 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:57.332211 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-457a4c78-c421-425a-920f-5f041cfdb946 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:57.332839 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-457a4c78-c421-425a-920f-5f041cfdb946 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:57.333384 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-457a4c78-c421-425a-920f-5f041cfdb946 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:57.333849 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-457a4c78-c421-425a-920f-5f041cfdb946 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:57.334304 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-457a4c78-c421-425a-920f-5f041cfdb946 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:57.348807 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-c20d8a2b-b7fe-4c38-b752-d0d838515d36 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:57.349861 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-c20d8a2b-b7fe-4c38-b752-d0d838515d36 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] [instance: 35d91cb7-f14b-4788-b503-ea9feaee650b] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:57.357855 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c20d8a2b-b7fe-4c38-b752-d0d838515d36 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:57.358714 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c20d8a2b-b7fe-4c38-b752-d0d838515d36 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:57.359404 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c20d8a2b-b7fe-4c38-b752-d0d838515d36 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:57.360372 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c20d8a2b-b7fe-4c38-b752-d0d838515d36 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:57.361139 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c20d8a2b-b7fe-4c38-b752-d0d838515d36 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:57.361827 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c20d8a2b-b7fe-4c38-b752-d0d838515d36 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:57.496047 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-c20d8a2b-b7fe-4c38-b752-d0d838515d36 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f931e726872474dae2b7b6fbb0eb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7bf59244bc487b84c7dbf9aa7314d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:57.506586 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-c20d8a2b-b7fe-4c38-b752-d0d838515d36 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] 10.222.0.61 "GET /compute/v2.1/servers/35d91cb7-f14b-4788-b503-ea9feaee650b" status: 200 len: 1472 microversion: 2.1 time: 0.161577 Aug 27 02:23:57.509875 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 213/432] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:23:57 2022] GET /compute/v2.1/servers/35d91cb7-f14b-4788-b503-ea9feaee650b => generated 1472 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:23:57.514148 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-457a4c78-c421-425a-920f-5f041cfdb946 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931dcabba0214e3daa878f31cd1706cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f956d4d27437c830871f6634a3018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:57.519513 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-2a95b255-c79f-44b0-8c65-f347f067d4a8 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:57.521206 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-2a95b255-c79f-44b0-8c65-f347f067d4a8 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] [instance: 9fb59350-4f09-4e20-bddb-ffc9a65897b3] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:57.523626 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-457a4c78-c421-425a-920f-5f041cfdb946 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] 10.222.0.61 "GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8" status: 200 len: 1358 microversion: 2.1 time: 0.214397 Aug 27 02:23:57.524223 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 220/433] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:23:57 2022] GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8 => generated 1358 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:23:57.529530 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2a95b255-c79f-44b0-8c65-f347f067d4a8 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:57.530129 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2a95b255-c79f-44b0-8c65-f347f067d4a8 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:57.530641 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2a95b255-c79f-44b0-8c65-f347f067d4a8 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:57.531603 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2a95b255-c79f-44b0-8c65-f347f067d4a8 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:57.532312 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2a95b255-c79f-44b0-8c65-f347f067d4a8 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:57.532824 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2a95b255-c79f-44b0-8c65-f347f067d4a8 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:57.630057 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-2a95b255-c79f-44b0-8c65-f347f067d4a8 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f53d57f3544e5a25e1beeddab9af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2d4ae1c228446eb5bfc64d44348fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:57.639080 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-2a95b255-c79f-44b0-8c65-f347f067d4a8 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] 10.222.0.61 "GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3" status: 200 len: 1139 microversion: 2.1 time: 0.125636 Aug 27 02:23:57.639672 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 214/434] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:23:57 2022] GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3 => generated 1139 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:23:58.180271 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-58dbced2-e635-4d15-8b84-d68329e04a21 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:58.181615 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-58dbced2-e635-4d15-8b84-d68329e04a21 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:58.192805 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-58dbced2-e635-4d15-8b84-d68329e04a21 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:58.193684 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-58dbced2-e635-4d15-8b84-d68329e04a21 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:58.194417 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-58dbced2-e635-4d15-8b84-d68329e04a21 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:58.195601 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-58dbced2-e635-4d15-8b84-d68329e04a21 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:58.196391 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-58dbced2-e635-4d15-8b84-d68329e04a21 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:58.197099 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-58dbced2-e635-4d15-8b84-d68329e04a21 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:58.424994 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-58dbced2-e635-4d15-8b84-d68329e04a21 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:58.442125 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-58dbced2-e635-4d15-8b84-d68329e04a21 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:58.443669 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-58dbced2-e635-4d15-8b84-d68329e04a21 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:58.444881 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-58dbced2-e635-4d15-8b84-d68329e04a21 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db" status: 200 len: 1751 microversion: 2.20 time: 0.270008 Aug 27 02:23:58.445464 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 221/435] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:23:58 2022] GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db => generated 1751 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:23:58.543168 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-65c3ddab-2f94-48a4-99e5-05b03115552f tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:58.544078 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-65c3ddab-2f94-48a4-99e5-05b03115552f tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] [instance: 35d91cb7-f14b-4788-b503-ea9feaee650b] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:58.548439 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-7ce8b372-9d00-421b-bf0e-3042a42af84e tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:58.549731 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-7ce8b372-9d00-421b-bf0e-3042a42af84e tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] [instance: 49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:58.552587 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-65c3ddab-2f94-48a4-99e5-05b03115552f tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:58.553282 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-65c3ddab-2f94-48a4-99e5-05b03115552f tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:58.553862 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-65c3ddab-2f94-48a4-99e5-05b03115552f tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:58.554677 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-65c3ddab-2f94-48a4-99e5-05b03115552f tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:58.555244 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-65c3ddab-2f94-48a4-99e5-05b03115552f tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:58.555778 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-65c3ddab-2f94-48a4-99e5-05b03115552f tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:58.556849 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7ce8b372-9d00-421b-bf0e-3042a42af84e tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:58.557445 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7ce8b372-9d00-421b-bf0e-3042a42af84e tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:58.557956 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7ce8b372-9d00-421b-bf0e-3042a42af84e tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:58.558905 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7ce8b372-9d00-421b-bf0e-3042a42af84e tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:58.559608 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7ce8b372-9d00-421b-bf0e-3042a42af84e tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:58.560196 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7ce8b372-9d00-421b-bf0e-3042a42af84e tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:58.639533 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-65c3ddab-2f94-48a4-99e5-05b03115552f tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f931e726872474dae2b7b6fbb0eb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7bf59244bc487b84c7dbf9aa7314d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:58.649176 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-65c3ddab-2f94-48a4-99e5-05b03115552f tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] 10.222.0.61 "GET /compute/v2.1/servers/35d91cb7-f14b-4788-b503-ea9feaee650b" status: 200 len: 1472 microversion: 2.1 time: 0.111830 Aug 27 02:23:58.650145 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 215/436] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:23:58 2022] GET /compute/v2.1/servers/35d91cb7-f14b-4788-b503-ea9feaee650b => generated 1472 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:23:58.670899 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-7ff347a4-3913-474d-a8aa-c6f91dc8ad4a tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:58.672047 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-7ff347a4-3913-474d-a8aa-c6f91dc8ad4a tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] [instance: 9fb59350-4f09-4e20-bddb-ffc9a65897b3] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:58.699712 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7ff347a4-3913-474d-a8aa-c6f91dc8ad4a tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:58.700506 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7ff347a4-3913-474d-a8aa-c6f91dc8ad4a tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:58.701293 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7ff347a4-3913-474d-a8aa-c6f91dc8ad4a tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:58.702628 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7ff347a4-3913-474d-a8aa-c6f91dc8ad4a tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:58.703515 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7ff347a4-3913-474d-a8aa-c6f91dc8ad4a tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:58.704336 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7ff347a4-3913-474d-a8aa-c6f91dc8ad4a tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:58.809782 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-7ce8b372-9d00-421b-bf0e-3042a42af84e tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931dcabba0214e3daa878f31cd1706cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f956d4d27437c830871f6634a3018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:58.811540 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-7ff347a4-3913-474d-a8aa-c6f91dc8ad4a tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f53d57f3544e5a25e1beeddab9af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2d4ae1c228446eb5bfc64d44348fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:58.822741 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-7ff347a4-3913-474d-a8aa-c6f91dc8ad4a tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] 10.222.0.61 "GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3" status: 200 len: 1139 microversion: 2.1 time: 0.159663 Aug 27 02:23:58.824000 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 216/437] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:23:58 2022] GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3 => generated 1139 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:23:58.837156 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-7ce8b372-9d00-421b-bf0e-3042a42af84e tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] 10.222.0.61 "GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8" status: 200 len: 1358 microversion: 2.1 time: 0.293319 Aug 27 02:23:58.850891 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 222/438] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:23:58 2022] GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8 => generated 1358 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:23:59.467787 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-41793f9f-7e15-4020-b76d-b2263988b3fc tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:59.468376 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-41793f9f-7e15-4020-b76d-b2263988b3fc tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:59.475612 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-41793f9f-7e15-4020-b76d-b2263988b3fc tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:59.476135 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-41793f9f-7e15-4020-b76d-b2263988b3fc tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:59.476615 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-41793f9f-7e15-4020-b76d-b2263988b3fc tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:59.477441 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-41793f9f-7e15-4020-b76d-b2263988b3fc tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:59.478074 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-41793f9f-7e15-4020-b76d-b2263988b3fc tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:59.478525 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-41793f9f-7e15-4020-b76d-b2263988b3fc tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:59.643806 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-41793f9f-7e15-4020-b76d-b2263988b3fc tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:59.652953 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-41793f9f-7e15-4020-b76d-b2263988b3fc tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:59.654416 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-41793f9f-7e15-4020-b76d-b2263988b3fc tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:59.655576 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-41793f9f-7e15-4020-b76d-b2263988b3fc tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db" status: 200 len: 1751 microversion: 2.20 time: 0.192005 Aug 27 02:23:59.656136 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 217/439] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:23:59 2022] GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db => generated 1751 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:23:59.677135 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-9f50ae03-d11b-46b0-ba54-fa706eec80ba tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:59.678330 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-9f50ae03-d11b-46b0-ba54-fa706eec80ba tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] [instance: 35d91cb7-f14b-4788-b503-ea9feaee650b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:59.689817 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9f50ae03-d11b-46b0-ba54-fa706eec80ba tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:59.690686 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9f50ae03-d11b-46b0-ba54-fa706eec80ba tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:59.691459 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9f50ae03-d11b-46b0-ba54-fa706eec80ba tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:59.692740 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9f50ae03-d11b-46b0-ba54-fa706eec80ba tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:59.693546 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9f50ae03-d11b-46b0-ba54-fa706eec80ba tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:59.694518 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9f50ae03-d11b-46b0-ba54-fa706eec80ba tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:59.788366 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-9f50ae03-d11b-46b0-ba54-fa706eec80ba tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f931e726872474dae2b7b6fbb0eb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7bf59244bc487b84c7dbf9aa7314d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:59.797301 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-9f50ae03-d11b-46b0-ba54-fa706eec80ba tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] 10.222.0.61 "GET /compute/v2.1/servers/35d91cb7-f14b-4788-b503-ea9feaee650b" status: 200 len: 1472 microversion: 2.1 time: 0.129261 Aug 27 02:23:59.798007 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 223/440] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:23:59 2022] GET /compute/v2.1/servers/35d91cb7-f14b-4788-b503-ea9feaee650b => generated 1472 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:23:59.858045 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-66956a60-d909-4b2d-8d17-1c52557d0b35 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:59.858806 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-66956a60-d909-4b2d-8d17-1c52557d0b35 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] [instance: 9fb59350-4f09-4e20-bddb-ffc9a65897b3] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:59.865742 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-66956a60-d909-4b2d-8d17-1c52557d0b35 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:59.866277 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-66956a60-d909-4b2d-8d17-1c52557d0b35 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:59.866742 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-66956a60-d909-4b2d-8d17-1c52557d0b35 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:59.867773 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-66956a60-d909-4b2d-8d17-1c52557d0b35 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:59.868690 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-66956a60-d909-4b2d-8d17-1c52557d0b35 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:59.869381 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-66956a60-d909-4b2d-8d17-1c52557d0b35 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:59.875809 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-e38c0228-834e-49ca-8592-d687e68fb7b4 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:23:59.876729 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-e38c0228-834e-49ca-8592-d687e68fb7b4 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] [instance: 49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:23:59.885209 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e38c0228-834e-49ca-8592-d687e68fb7b4 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:59.885866 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e38c0228-834e-49ca-8592-d687e68fb7b4 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:59.886375 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e38c0228-834e-49ca-8592-d687e68fb7b4 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:59.887183 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e38c0228-834e-49ca-8592-d687e68fb7b4 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:23:59.887706 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e38c0228-834e-49ca-8592-d687e68fb7b4 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:23:59.888258 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e38c0228-834e-49ca-8592-d687e68fb7b4 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:23:59.952902 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-66956a60-d909-4b2d-8d17-1c52557d0b35 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f53d57f3544e5a25e1beeddab9af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2d4ae1c228446eb5bfc64d44348fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:23:59.962065 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-66956a60-d909-4b2d-8d17-1c52557d0b35 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] 10.222.0.61 "GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3" status: 200 len: 1139 microversion: 2.1 time: 0.107875 Aug 27 02:23:59.963133 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 218/441] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:23:59 2022] GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3 => generated 1139 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:24:00.041220 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-e38c0228-834e-49ca-8592-d687e68fb7b4 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931dcabba0214e3daa878f31cd1706cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f956d4d27437c830871f6634a3018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:00.049770 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-e38c0228-834e-49ca-8592-d687e68fb7b4 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] 10.222.0.61 "GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8" status: 200 len: 1358 microversion: 2.1 time: 0.178766 Aug 27 02:24:00.050340 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 224/442] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:23:59 2022] GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8 => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:24:00.691839 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-9bf124dd-ced4-4f6f-894f-6ee8a9c360d4 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:00.694982 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-9bf124dd-ced4-4f6f-894f-6ee8a9c360d4 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:00.703503 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9bf124dd-ced4-4f6f-894f-6ee8a9c360d4 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:00.704015 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9bf124dd-ced4-4f6f-894f-6ee8a9c360d4 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:00.704440 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9bf124dd-ced4-4f6f-894f-6ee8a9c360d4 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:00.705320 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9bf124dd-ced4-4f6f-894f-6ee8a9c360d4 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:00.705993 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9bf124dd-ced4-4f6f-894f-6ee8a9c360d4 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:00.706565 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9bf124dd-ced4-4f6f-894f-6ee8a9c360d4 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:00.821796 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-70e9902d-49f0-4aa9-95f2-46344a5534cc tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:00.822402 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-70e9902d-49f0-4aa9-95f2-46344a5534cc tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] [instance: 35d91cb7-f14b-4788-b503-ea9feaee650b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:00.840415 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-70e9902d-49f0-4aa9-95f2-46344a5534cc tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:00.847976 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-70e9902d-49f0-4aa9-95f2-46344a5534cc tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:00.848472 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-70e9902d-49f0-4aa9-95f2-46344a5534cc tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:00.850367 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-70e9902d-49f0-4aa9-95f2-46344a5534cc tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:00.850941 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-70e9902d-49f0-4aa9-95f2-46344a5534cc tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:00.852162 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-70e9902d-49f0-4aa9-95f2-46344a5534cc tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:00.899876 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell1:SELECT=100 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:24:00.933548 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-70e9902d-49f0-4aa9-95f2-46344a5534cc tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:00.934507 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-70e9902d-49f0-4aa9-95f2-46344a5534cc tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:00.935116 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-70e9902d-49f0-4aa9-95f2-46344a5534cc tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:00.935825 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.objects.instance [None req-70e9902d-49f0-4aa9-95f2-46344a5534cc tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lazy-loading 'fault' on Instance uuid 35d91cb7-f14b-4788-b503-ea9feaee650b {{(pid=120782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:24:00.942076 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-9bf124dd-ced4-4f6f-894f-6ee8a9c360d4 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:00.972794 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-9bf124dd-ced4-4f6f-894f-6ee8a9c360d4 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:00.974471 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-9bf124dd-ced4-4f6f-894f-6ee8a9c360d4 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:00.980675 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-9bf124dd-ced4-4f6f-894f-6ee8a9c360d4 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db" status: 200 len: 1751 microversion: 2.20 time: 0.299383 Aug 27 02:24:00.985681 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 219/443] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:24:00 2022] GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db => generated 1751 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:24:01.002282 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-40f76cdd-05e3-4dc6-92ef-8cf0f4a034e9 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:01.003759 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-40f76cdd-05e3-4dc6-92ef-8cf0f4a034e9 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] [instance: 9fb59350-4f09-4e20-bddb-ffc9a65897b3] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:01.015311 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-40f76cdd-05e3-4dc6-92ef-8cf0f4a034e9 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:01.016756 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-40f76cdd-05e3-4dc6-92ef-8cf0f4a034e9 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:01.017772 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-40f76cdd-05e3-4dc6-92ef-8cf0f4a034e9 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:01.018973 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-40f76cdd-05e3-4dc6-92ef-8cf0f4a034e9 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:01.019840 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-40f76cdd-05e3-4dc6-92ef-8cf0f4a034e9 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:01.021352 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-40f76cdd-05e3-4dc6-92ef-8cf0f4a034e9 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:01.115897 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-40f76cdd-05e3-4dc6-92ef-8cf0f4a034e9 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f53d57f3544e5a25e1beeddab9af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2d4ae1c228446eb5bfc64d44348fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:01.136305 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-40f76cdd-05e3-4dc6-92ef-8cf0f4a034e9 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] 10.222.0.61 "GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3" status: 200 len: 1187 microversion: 2.1 time: 0.148200 Aug 27 02:24:01.159832 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 220/444] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:00 2022] GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3 => generated 1187 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:24:01.178016 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-ae94ac4f-7dfc-4ed3-b99a-8edd46ee062a tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:01.179997 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-ae94ac4f-7dfc-4ed3-b99a-8edd46ee062a tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: d5c72277-dabd-484c-9e20-279b6159516a] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:01.189631 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ae94ac4f-7dfc-4ed3-b99a-8edd46ee062a tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:01.190716 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ae94ac4f-7dfc-4ed3-b99a-8edd46ee062a tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:01.191620 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ae94ac4f-7dfc-4ed3-b99a-8edd46ee062a tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:01.192796 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ae94ac4f-7dfc-4ed3-b99a-8edd46ee062a tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:01.193144 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ae94ac4f-7dfc-4ed3-b99a-8edd46ee062a tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:01.193572 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ae94ac4f-7dfc-4ed3-b99a-8edd46ee062a tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:01.221629 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-ae94ac4f-7dfc-4ed3-b99a-8edd46ee062a tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/d5c72277-dabd-484c-9e20-279b6159516a/ips" status: 200 len: 151 microversion: 2.1 time: 0.051871 Aug 27 02:24:01.222062 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 221/445] 10.222.0.61 () {58 vars in 1248 bytes} [Sat Aug 27 02:24:01 2022] GET /compute/v2.1/servers/d5c72277-dabd-484c-9e20-279b6159516a/ips => generated 151 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:24:01.227466 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-70662a52-623e-458e-96c0-079dcdf620c4 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:01.228094 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-70662a52-623e-458e-96c0-079dcdf620c4 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] [instance: 49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:01.235176 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-70662a52-623e-458e-96c0-079dcdf620c4 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:01.235669 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-70662a52-623e-458e-96c0-079dcdf620c4 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:01.236103 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-70662a52-623e-458e-96c0-079dcdf620c4 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:01.236833 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-70662a52-623e-458e-96c0-079dcdf620c4 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:01.237337 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-70662a52-623e-458e-96c0-079dcdf620c4 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:01.237795 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-70662a52-623e-458e-96c0-079dcdf620c4 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:01.442217 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-70e9902d-49f0-4aa9-95f2-46344a5534cc tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f931e726872474dae2b7b6fbb0eb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7bf59244bc487b84c7dbf9aa7314d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:01.452636 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-70e9902d-49f0-4aa9-95f2-46344a5534cc tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] 10.222.0.61 "GET /compute/v2.1/servers/35d91cb7-f14b-4788-b503-ea9feaee650b" status: 200 len: 1309 microversion: 2.1 time: 0.635020 Aug 27 02:24:01.468755 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 225/446] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:00 2022] GET /compute/v2.1/servers/35d91cb7-f14b-4788-b503-ea9feaee650b => generated 1309 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:24:01.473905 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-70662a52-623e-458e-96c0-079dcdf620c4 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931dcabba0214e3daa878f31cd1706cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f956d4d27437c830871f6634a3018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:01.475443 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-7aaa3ed7-9054-4575-9568-8c0797db1404 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a6f9a924-9d70-4cd3-8d74-8de7e1d35caa"}} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:24:01.480648 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-7aaa3ed7-9054-4575-9568-8c0797db1404 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: d5c72277-dabd-484c-9e20-279b6159516a] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:01.486187 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell1:SELECT=100 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:24:01.490168 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7aaa3ed7-9054-4575-9568-8c0797db1404 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:01.492031 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7aaa3ed7-9054-4575-9568-8c0797db1404 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:01.492601 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7aaa3ed7-9054-4575-9568-8c0797db1404 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:01.493505 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7aaa3ed7-9054-4575-9568-8c0797db1404 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:01.494142 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7aaa3ed7-9054-4575-9568-8c0797db1404 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:01.494573 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7aaa3ed7-9054-4575-9568-8c0797db1404 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:01.506495 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-70662a52-623e-458e-96c0-079dcdf620c4 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] 10.222.0.61 "GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8" status: 200 len: 1358 microversion: 2.1 time: 0.283236 Aug 27 02:24:01.516729 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 222/447] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:01 2022] GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8 => generated 1358 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:24:01.616349 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.wsgi [None req-7aaa3ed7-9054-4575-9568-8c0797db1404 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] HTTP exception thrown: Invalid volume: volume a6f9a924-9d70-4cd3-8d74-8de7e1d35caa is already attached to instances: 268d786c-398a-4305-85ac-545fa3b4370b Aug 27 02:24:01.618179 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-7aaa3ed7-9054-4575-9568-8c0797db1404 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Request method failure captured: Aug 27 02:24:01.618179 dv-cinder-846303-3-smb devstack@n-api.service[120782]: request: POST /compute/v2.1/servers/d5c72277-dabd-484c-9e20-279b6159516a/os-volume_attachments HTTP/1.1 Aug 27 02:24:01.618179 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Accept: application/json Aug 27 02:24:01.618179 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Accept-Encoding: identity Aug 27 02:24:01.618179 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Connection: close Aug 27 02:24:01.618179 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Content-Length: 74 Aug 27 02:24:01.618179 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Content-Type: application/json Aug 27 02:24:01.618179 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Host: 10.222.0.61 Aug 27 02:24:01.618179 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Openstack-System-Scope: None Aug 27 02:24:01.618179 dv-cinder-846303-3-smb devstack@n-api.service[120782]: User-Agent: python-urllib3/1.26.11 Aug 27 02:24:01.618179 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Auth-Token: gAAAAABjCX-GZMxBoDm0UEKrtF9w1zn8zf5k_pRKs9w1w8QBRmamyePi9gdcvRwYzK044f89BKz1wZ6FALfNLv1C6uDnz_VZDZcPY_z2HcyDI5nmMGMvL5rG2v4zh3O1IrszVG_kNPPcMoviX7QaOQhXuRqD1X6DsEJwS6gyWrQ-SPSaYeWVQOw Aug 27 02:24:01.618179 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Domain-Id: None Aug 27 02:24:01.618179 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Domain-Name: None Aug 27 02:24:01.618179 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Identity-Status: Confirmed Aug 27 02:24:01.618179 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Is-Admin-Project: True Aug 27 02:24:01.618179 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Domain-Id: default Aug 27 02:24:01.618179 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Domain-Name: Default Aug 27 02:24:01.618179 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Id: 8aa1c411b57d4e72885dac2b4f4dfe7a Aug 27 02:24:01.618179 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Name: tempest-AttachVolumeNegativeTest-799378516 Aug 27 02:24:01.618179 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Role: member,reader Aug 27 02:24:01.618179 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Roles: member,reader Aug 27 02:24:01.622268 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/8aa1c411b57d4e72885dac2b4f4dfe7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_8aa1c411b57d4e72885dac2b4f4dfe7a", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8aa1c411b57d4e72885dac2b4f4dfe7a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8aa1c411b57d4e72885dac2b4f4dfe7a"}]}] Aug 27 02:24:01.622268 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Tenant: tempest-AttachVolumeNegativeTest-799378516 Aug 27 02:24:01.622268 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Tenant-Id: 8aa1c411b57d4e72885dac2b4f4dfe7a Aug 27 02:24:01.622268 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-799378516 Aug 27 02:24:01.622268 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User: tempest-AttachVolumeNegativeTest-799378516-project Aug 27 02:24:01.622268 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Domain-Id: default Aug 27 02:24:01.622268 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Domain-Name: Default Aug 27 02:24:01.622268 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Id: 4a6f819365574091ae344f14e47f487f Aug 27 02:24:01.622268 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Name: tempest-AttachVolumeNegativeTest-799378516-project Aug 27 02:24:01.622268 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Aug 27 02:24:01.622268 dv-cinder-846303-3-smb devstack@n-api.service[120782]: {"volumeAttachment": {"volumeId": "a6f9a924-9d70-4cd3-8d74-8de7e1d35caa"}} Aug 27 02:24:01.622268 dv-cinder-846303-3-smb devstack@n-api.service[120782]: method: > Aug 27 02:24:01.623034 dv-cinder-846303-3-smb devstack@n-api.service[120782]: exception: Invalid volume: volume a6f9a924-9d70-4cd3-8d74-8de7e1d35caa is already attached to instances: 268d786c-398a-4305-85ac-545fa3b4370b Aug 27 02:24:01.623034 dv-cinder-846303-3-smb devstack@n-api.service[120782]: action_args: {'server_id': 'd5c72277-dabd-484c-9e20-279b6159516a', 'body': {'volumeAttachment': {'volumeId': 'a6f9a924-9d70-4cd3-8d74-8de7e1d35caa'}}} Aug 27 02:24:01.623034 dv-cinder-846303-3-smb devstack@n-api.service[120782]: {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:24:01.623034 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:24:01.623034 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 27 02:24:01.623034 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 27 02:24:01.623034 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 02:24:01.623034 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 02:24:01.623034 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 27 02:24:01.623034 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 02:24:01.623034 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 27 02:24:01.623034 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 27 02:24:01.623034 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 27 02:24:01.623034 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 27 02:24:01.623034 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume a6f9a924-9d70-4cd3-8d74-8de7e1d35caa is already attached to instances: 268d786c-398a-4305-85ac-545fa3b4370b Aug 27 02:24:01.623034 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:24:01.623034 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:24:01.623034 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:24:01.623034 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:24:01.624374 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:24:01.624374 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:24:01.624374 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:24:01.624374 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:24:01.624374 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:24:01.624374 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:24:01.624374 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:24:01.624374 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:24:01.624374 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:24:01.624374 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:24:01.624374 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:24:01.624374 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:24:01.624374 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 27 02:24:01.624374 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 27 02:24:01.624374 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume a6f9a924-9d70-4cd3-8d74-8de7e1d35caa is already attached to instances: 268d786c-398a-4305-85ac-545fa3b4370b Aug 27 02:24:01.624374 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:24:01.624374 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:24:01.624374 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:24:01.624374 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:24:01.624374 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:24:01.625979 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:24:01.625979 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:24:01.625979 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:24:01.625979 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume a6f9a924-9d70-4cd3-8d74-8de7e1d35caa is already attached to instances: 268d786c-398a-4305-85ac-545fa3b4370b Aug 27 02:24:01.625979 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:24:01.625979 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-7aaa3ed7-9054-4575-9568-8c0797db1404 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Returning 400 to user: Invalid volume: volume a6f9a924-9d70-4cd3-8d74-8de7e1d35caa is already attached to instances: 268d786c-398a-4305-85ac-545fa3b4370b {{(pid=120782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:24:01.625979 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-7aaa3ed7-9054-4575-9568-8c0797db1404 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "POST /compute/v2.1/servers/d5c72277-dabd-484c-9e20-279b6159516a/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.149318 Aug 27 02:24:01.625979 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 226/448] 10.222.0.61 () {60 vars in 1323 bytes} [Sat Aug 27 02:24:01 2022] POST /compute/v2.1/servers/d5c72277-dabd-484c-9e20-279b6159516a/os-volume_attachments => generated 174 bytes in 151 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:24:01.635677 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-d39aeeb2-91cd-4c8d-8f4b-641e18d73ce8 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:01.636522 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-d39aeeb2-91cd-4c8d-8f4b-641e18d73ce8 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: d5c72277-dabd-484c-9e20-279b6159516a] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:01.647824 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d39aeeb2-91cd-4c8d-8f4b-641e18d73ce8 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:01.648694 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d39aeeb2-91cd-4c8d-8f4b-641e18d73ce8 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:01.649549 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d39aeeb2-91cd-4c8d-8f4b-641e18d73ce8 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:01.650854 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d39aeeb2-91cd-4c8d-8f4b-641e18d73ce8 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:01.651657 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d39aeeb2-91cd-4c8d-8f4b-641e18d73ce8 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:01.652408 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d39aeeb2-91cd-4c8d-8f4b-641e18d73ce8 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:01.684155 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-d39aeeb2-91cd-4c8d-8f4b-641e18d73ce8 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: d5c72277-dabd-484c-9e20-279b6159516a] Going to try to terminate instance {{(pid=120783) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:24:01.773707 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-d39aeeb2-91cd-4c8d-8f4b-641e18d73ce8 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "DELETE /compute/v2.1/servers/d5c72277-dabd-484c-9e20-279b6159516a" status: 204 len: 0 microversion: 2.1 time: 0.144917 Aug 27 02:24:01.774656 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 223/449] 10.222.0.61 () {58 vars in 1239 bytes} [Sat Aug 27 02:24:01 2022] DELETE /compute/v2.1/servers/d5c72277-dabd-484c-9e20-279b6159516a => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:24:01.782761 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-d0338a57-287b-4d7d-9cb2-a40174c40a4f tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:01.783376 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-d0338a57-287b-4d7d-9cb2-a40174c40a4f tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: d5c72277-dabd-484c-9e20-279b6159516a] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:01.792153 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d0338a57-287b-4d7d-9cb2-a40174c40a4f tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:01.792752 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d0338a57-287b-4d7d-9cb2-a40174c40a4f tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:01.793015 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d0338a57-287b-4d7d-9cb2-a40174c40a4f tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:01.793774 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d0338a57-287b-4d7d-9cb2-a40174c40a4f tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:01.794220 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d0338a57-287b-4d7d-9cb2-a40174c40a4f tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:01.794635 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d0338a57-287b-4d7d-9cb2-a40174c40a4f tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:02.009291 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-e285d7cd-4bc5-467a-bf1c-c253a23bd59f tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:02.010063 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-e285d7cd-4bc5-467a-bf1c-c253a23bd59f tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:02.017652 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e285d7cd-4bc5-467a-bf1c-c253a23bd59f tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:02.018161 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e285d7cd-4bc5-467a-bf1c-c253a23bd59f tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:02.018595 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e285d7cd-4bc5-467a-bf1c-c253a23bd59f tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:02.019345 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e285d7cd-4bc5-467a-bf1c-c253a23bd59f tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:02.019798 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e285d7cd-4bc5-467a-bf1c-c253a23bd59f tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:02.020215 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e285d7cd-4bc5-467a-bf1c-c253a23bd59f tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:02.090659 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-d0338a57-287b-4d7d-9cb2-a40174c40a4f tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6f819365574091ae344f14e47f487f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa1c411b57d4e72885dac2b4f4dfe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:02.105059 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-d0338a57-287b-4d7d-9cb2-a40174c40a4f tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/d5c72277-dabd-484c-9e20-279b6159516a" status: 200 len: 1683 microversion: 2.1 time: 0.325788 Aug 27 02:24:02.105852 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 227/450] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:01 2022] GET /compute/v2.1/servers/d5c72277-dabd-484c-9e20-279b6159516a => generated 1683 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:24:02.177325 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-2b0f0d3e-9dbd-4b90-91d6-888e1ad00c15 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:02.177918 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-2b0f0d3e-9dbd-4b90-91d6-888e1ad00c15 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] [instance: 9fb59350-4f09-4e20-bddb-ffc9a65897b3] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:02.182959 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-e285d7cd-4bc5-467a-bf1c-c253a23bd59f tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:02.187686 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2b0f0d3e-9dbd-4b90-91d6-888e1ad00c15 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:02.188329 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2b0f0d3e-9dbd-4b90-91d6-888e1ad00c15 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:02.189010 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2b0f0d3e-9dbd-4b90-91d6-888e1ad00c15 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:02.190214 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2b0f0d3e-9dbd-4b90-91d6-888e1ad00c15 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:02.190963 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2b0f0d3e-9dbd-4b90-91d6-888e1ad00c15 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:02.192164 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2b0f0d3e-9dbd-4b90-91d6-888e1ad00c15 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:02.198483 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-e285d7cd-4bc5-467a-bf1c-c253a23bd59f tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:02.200330 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-e285d7cd-4bc5-467a-bf1c-c253a23bd59f tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:02.202302 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-e285d7cd-4bc5-467a-bf1c-c253a23bd59f tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db" status: 200 len: 1807 microversion: 2.20 time: 0.197685 Aug 27 02:24:02.203350 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 224/451] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:24:02 2022] GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db => generated 1807 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:24:02.287759 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-2b0f0d3e-9dbd-4b90-91d6-888e1ad00c15 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f53d57f3544e5a25e1beeddab9af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2d4ae1c228446eb5bfc64d44348fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:02.296248 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-2b0f0d3e-9dbd-4b90-91d6-888e1ad00c15 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] 10.222.0.61 "GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3" status: 200 len: 1187 microversion: 2.1 time: 0.123683 Aug 27 02:24:02.296825 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 228/452] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:02 2022] GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3 => generated 1187 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:24:02.475145 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-b6b0f098-e90c-4542-b561-7630cbc98e04 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:02.475793 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-b6b0f098-e90c-4542-b561-7630cbc98e04 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] [instance: 35d91cb7-f14b-4788-b503-ea9feaee650b] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:02.483152 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b6b0f098-e90c-4542-b561-7630cbc98e04 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:02.483697 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b6b0f098-e90c-4542-b561-7630cbc98e04 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:02.484160 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b6b0f098-e90c-4542-b561-7630cbc98e04 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:02.484982 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b6b0f098-e90c-4542-b561-7630cbc98e04 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:02.485608 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b6b0f098-e90c-4542-b561-7630cbc98e04 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:02.486165 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b6b0f098-e90c-4542-b561-7630cbc98e04 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:02.524012 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b6b0f098-e90c-4542-b561-7630cbc98e04 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:02.524686 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b6b0f098-e90c-4542-b561-7630cbc98e04 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:02.525364 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b6b0f098-e90c-4542-b561-7630cbc98e04 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:02.526175 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.objects.instance [None req-b6b0f098-e90c-4542-b561-7630cbc98e04 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lazy-loading 'fault' on Instance uuid 35d91cb7-f14b-4788-b503-ea9feaee650b {{(pid=120783) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:24:02.532604 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-682f66b1-3c13-4598-b3ff-254b4ea6258c tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:02.533372 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-682f66b1-3c13-4598-b3ff-254b4ea6258c tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] [instance: 49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:02.541940 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-682f66b1-3c13-4598-b3ff-254b4ea6258c tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:02.542636 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-682f66b1-3c13-4598-b3ff-254b4ea6258c tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:02.543234 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-682f66b1-3c13-4598-b3ff-254b4ea6258c tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:02.544089 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-682f66b1-3c13-4598-b3ff-254b4ea6258c tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:02.544642 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-682f66b1-3c13-4598-b3ff-254b4ea6258c tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:02.545157 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-682f66b1-3c13-4598-b3ff-254b4ea6258c tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:02.584441 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-b6b0f098-e90c-4542-b561-7630cbc98e04 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f931e726872474dae2b7b6fbb0eb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7bf59244bc487b84c7dbf9aa7314d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:02.598227 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-b6b0f098-e90c-4542-b561-7630cbc98e04 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] 10.222.0.61 "GET /compute/v2.1/servers/35d91cb7-f14b-4788-b503-ea9feaee650b" status: 200 len: 1309 microversion: 2.1 time: 0.126894 Aug 27 02:24:02.599131 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 225/453] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:02 2022] GET /compute/v2.1/servers/35d91cb7-f14b-4788-b503-ea9feaee650b => generated 1309 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:24:02.732010 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-682f66b1-3c13-4598-b3ff-254b4ea6258c tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931dcabba0214e3daa878f31cd1706cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f956d4d27437c830871f6634a3018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:02.740599 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-682f66b1-3c13-4598-b3ff-254b4ea6258c tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] 10.222.0.61 "GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8" status: 200 len: 1358 microversion: 2.1 time: 0.212822 Aug 27 02:24:02.741149 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 229/454] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:02 2022] GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8 => generated 1358 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:24:03.139150 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-b023c3c0-ca82-4c74-bc36-c0d598f9b2a5 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:03.139851 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-b023c3c0-ca82-4c74-bc36-c0d598f9b2a5 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: d5c72277-dabd-484c-9e20-279b6159516a] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:03.147405 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b023c3c0-ca82-4c74-bc36-c0d598f9b2a5 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:03.147888 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b023c3c0-ca82-4c74-bc36-c0d598f9b2a5 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:03.148319 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b023c3c0-ca82-4c74-bc36-c0d598f9b2a5 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:03.149012 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b023c3c0-ca82-4c74-bc36-c0d598f9b2a5 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:03.149477 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b023c3c0-ca82-4c74-bc36-c0d598f9b2a5 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:03.149905 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b023c3c0-ca82-4c74-bc36-c0d598f9b2a5 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:03.238577 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-426cac30-0a47-44c2-ae4b-34d66c8958e0 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:03.239627 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-426cac30-0a47-44c2-ae4b-34d66c8958e0 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:03.251005 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-426cac30-0a47-44c2-ae4b-34d66c8958e0 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:03.251852 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-426cac30-0a47-44c2-ae4b-34d66c8958e0 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:03.252924 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-426cac30-0a47-44c2-ae4b-34d66c8958e0 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:03.254169 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-426cac30-0a47-44c2-ae4b-34d66c8958e0 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:03.254972 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-426cac30-0a47-44c2-ae4b-34d66c8958e0 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:03.255710 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-426cac30-0a47-44c2-ae4b-34d66c8958e0 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:03.314231 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-b023c3c0-ca82-4c74-bc36-c0d598f9b2a5 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6f819365574091ae344f14e47f487f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa1c411b57d4e72885dac2b4f4dfe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:03.330741 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-b023c3c0-ca82-4c74-bc36-c0d598f9b2a5 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/d5c72277-dabd-484c-9e20-279b6159516a" status: 200 len: 1683 microversion: 2.1 time: 0.195178 Aug 27 02:24:03.331786 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 226/455] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:03 2022] GET /compute/v2.1/servers/d5c72277-dabd-484c-9e20-279b6159516a => generated 1683 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:24:03.340269 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-38e98e59-cadb-44fb-808b-a7e87f80e6fc tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:03.341439 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-38e98e59-cadb-44fb-808b-a7e87f80e6fc tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] [instance: 9fb59350-4f09-4e20-bddb-ffc9a65897b3] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:03.353228 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-38e98e59-cadb-44fb-808b-a7e87f80e6fc tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:03.353865 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-38e98e59-cadb-44fb-808b-a7e87f80e6fc tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:03.354457 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-38e98e59-cadb-44fb-808b-a7e87f80e6fc tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:03.355250 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-38e98e59-cadb-44fb-808b-a7e87f80e6fc tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:03.355786 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-38e98e59-cadb-44fb-808b-a7e87f80e6fc tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:03.356414 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-38e98e59-cadb-44fb-808b-a7e87f80e6fc tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:03.431800 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-426cac30-0a47-44c2-ae4b-34d66c8958e0 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:03.441727 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-426cac30-0a47-44c2-ae4b-34d66c8958e0 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:03.443287 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-426cac30-0a47-44c2-ae4b-34d66c8958e0 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:03.444533 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-426cac30-0a47-44c2-ae4b-34d66c8958e0 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db" status: 200 len: 1807 microversion: 2.20 time: 0.213289 Aug 27 02:24:03.445022 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-38e98e59-cadb-44fb-808b-a7e87f80e6fc tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f53d57f3544e5a25e1beeddab9af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2d4ae1c228446eb5bfc64d44348fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:03.445214 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 230/456] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:24:03 2022] GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db => generated 1807 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:24:03.453939 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-38e98e59-cadb-44fb-808b-a7e87f80e6fc tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] 10.222.0.61 "GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3" status: 200 len: 1187 microversion: 2.1 time: 0.120687 Aug 27 02:24:03.454529 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 227/457] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:03 2022] GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3 => generated 1187 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:24:03.628689 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-470446a5-575d-4847-ac45-fcf38132fdec tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:03.629377 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-470446a5-575d-4847-ac45-fcf38132fdec tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] [instance: 35d91cb7-f14b-4788-b503-ea9feaee650b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:03.636383 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-470446a5-575d-4847-ac45-fcf38132fdec tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:03.637052 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-470446a5-575d-4847-ac45-fcf38132fdec tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:03.637579 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-470446a5-575d-4847-ac45-fcf38132fdec tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:03.638349 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-470446a5-575d-4847-ac45-fcf38132fdec tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:03.638843 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-470446a5-575d-4847-ac45-fcf38132fdec tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:03.639299 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-470446a5-575d-4847-ac45-fcf38132fdec tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:03.673319 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-470446a5-575d-4847-ac45-fcf38132fdec tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:03.673875 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-470446a5-575d-4847-ac45-fcf38132fdec tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:03.674304 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-470446a5-575d-4847-ac45-fcf38132fdec tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:03.674750 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.objects.instance [None req-470446a5-575d-4847-ac45-fcf38132fdec tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lazy-loading 'fault' on Instance uuid 35d91cb7-f14b-4788-b503-ea9feaee650b {{(pid=120782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:24:03.719723 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-470446a5-575d-4847-ac45-fcf38132fdec tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f931e726872474dae2b7b6fbb0eb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7bf59244bc487b84c7dbf9aa7314d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:03.728482 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-470446a5-575d-4847-ac45-fcf38132fdec tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] 10.222.0.61 "GET /compute/v2.1/servers/35d91cb7-f14b-4788-b503-ea9feaee650b" status: 200 len: 1309 microversion: 2.1 time: 0.103827 Aug 27 02:24:03.729140 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 231/458] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:03 2022] GET /compute/v2.1/servers/35d91cb7-f14b-4788-b503-ea9feaee650b => generated 1309 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:24:03.761957 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-e1dff17e-a0f3-4f49-8af1-a4afb6714fe3 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:03.762645 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-e1dff17e-a0f3-4f49-8af1-a4afb6714fe3 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] [instance: 49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:03.765160 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell0:SELECT=2 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:24:03.766548 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell0:SELECT=6 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:24:03.774020 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e1dff17e-a0f3-4f49-8af1-a4afb6714fe3 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:03.774612 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e1dff17e-a0f3-4f49-8af1-a4afb6714fe3 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:03.775101 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e1dff17e-a0f3-4f49-8af1-a4afb6714fe3 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:03.775866 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e1dff17e-a0f3-4f49-8af1-a4afb6714fe3 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:03.776378 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e1dff17e-a0f3-4f49-8af1-a4afb6714fe3 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:03.776854 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e1dff17e-a0f3-4f49-8af1-a4afb6714fe3 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:03.965702 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-e1dff17e-a0f3-4f49-8af1-a4afb6714fe3 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931dcabba0214e3daa878f31cd1706cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f956d4d27437c830871f6634a3018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:03.980293 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-e1dff17e-a0f3-4f49-8af1-a4afb6714fe3 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] 10.222.0.61 "GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8" status: 200 len: 1358 microversion: 2.1 time: 0.221737 Aug 27 02:24:03.981197 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 228/459] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:03 2022] GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8 => generated 1358 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:24:04.365449 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-b4df25c6-72c7-4c56-b31b-bfdc5f24739e tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:04.372403 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-b4df25c6-72c7-4c56-b31b-bfdc5f24739e tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: d5c72277-dabd-484c-9e20-279b6159516a] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:04.399086 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell0:SELECT=2 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:24:04.402837 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b4df25c6-72c7-4c56-b31b-bfdc5f24739e tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:04.403700 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b4df25c6-72c7-4c56-b31b-bfdc5f24739e tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:04.404471 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b4df25c6-72c7-4c56-b31b-bfdc5f24739e tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:04.405796 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b4df25c6-72c7-4c56-b31b-bfdc5f24739e tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:04.406622 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b4df25c6-72c7-4c56-b31b-bfdc5f24739e tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:04.407355 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b4df25c6-72c7-4c56-b31b-bfdc5f24739e tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:04.479825 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-d5f35641-270a-489c-9d95-352a23d0ff1f tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:04.482173 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-d5f35641-270a-489c-9d95-352a23d0ff1f tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] [instance: 9fb59350-4f09-4e20-bddb-ffc9a65897b3] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:04.511888 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d5f35641-270a-489c-9d95-352a23d0ff1f tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:04.513132 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d5f35641-270a-489c-9d95-352a23d0ff1f tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:04.514043 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d5f35641-270a-489c-9d95-352a23d0ff1f tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:04.515780 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d5f35641-270a-489c-9d95-352a23d0ff1f tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:04.517208 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d5f35641-270a-489c-9d95-352a23d0ff1f tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:04.518137 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d5f35641-270a-489c-9d95-352a23d0ff1f tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:04.661018 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-d5f35641-270a-489c-9d95-352a23d0ff1f tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f53d57f3544e5a25e1beeddab9af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2d4ae1c228446eb5bfc64d44348fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:04.677707 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-d5f35641-270a-489c-9d95-352a23d0ff1f tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] 10.222.0.61 "GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3" status: 200 len: 1205 microversion: 2.1 time: 0.204450 Aug 27 02:24:04.679184 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 229/460] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:04 2022] GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3 => generated 1205 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:24:04.688514 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-c484d9c9-77a6-472b-a740-c8d3981e2e81 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:04.691162 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-c484d9c9-77a6-472b-a740-c8d3981e2e81 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:04.709670 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c484d9c9-77a6-472b-a740-c8d3981e2e81 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:04.711564 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c484d9c9-77a6-472b-a740-c8d3981e2e81 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:04.715054 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c484d9c9-77a6-472b-a740-c8d3981e2e81 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:04.716275 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c484d9c9-77a6-472b-a740-c8d3981e2e81 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:04.717820 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c484d9c9-77a6-472b-a740-c8d3981e2e81 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:04.718468 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c484d9c9-77a6-472b-a740-c8d3981e2e81 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:04.755073 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-b4df25c6-72c7-4c56-b31b-bfdc5f24739e tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6f819365574091ae344f14e47f487f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa1c411b57d4e72885dac2b4f4dfe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:04.770482 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-b4df25c6-72c7-4c56-b31b-bfdc5f24739e tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/d5c72277-dabd-484c-9e20-279b6159516a" status: 200 len: 1683 microversion: 2.1 time: 0.416200 Aug 27 02:24:04.771902 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 232/461] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:04 2022] GET /compute/v2.1/servers/d5c72277-dabd-484c-9e20-279b6159516a => generated 1683 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:24:04.787938 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-cd37a2ad-100e-44ac-b265-b1b56556e671 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:04.789504 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-cd37a2ad-100e-44ac-b265-b1b56556e671 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] [instance: 35d91cb7-f14b-4788-b503-ea9feaee650b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:04.797099 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cd37a2ad-100e-44ac-b265-b1b56556e671 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:04.797699 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cd37a2ad-100e-44ac-b265-b1b56556e671 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:04.798288 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cd37a2ad-100e-44ac-b265-b1b56556e671 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:04.799064 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cd37a2ad-100e-44ac-b265-b1b56556e671 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:04.799772 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cd37a2ad-100e-44ac-b265-b1b56556e671 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:04.800337 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cd37a2ad-100e-44ac-b265-b1b56556e671 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:04.817051 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.wsgi [None req-cd37a2ad-100e-44ac-b265-b1b56556e671 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] HTTP exception thrown: Instance 35d91cb7-f14b-4788-b503-ea9feaee650b could not be found. Aug 27 02:24:04.818994 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-cd37a2ad-100e-44ac-b265-b1b56556e671 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Request method failure captured: Aug 27 02:24:04.818994 dv-cinder-846303-3-smb devstack@n-api.service[120782]: request: GET /compute/v2.1/servers/35d91cb7-f14b-4788-b503-ea9feaee650b HTTP/1.1 Aug 27 02:24:04.818994 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Accept: application/json Aug 27 02:24:04.818994 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Accept-Encoding: identity Aug 27 02:24:04.818994 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Connection: close Aug 27 02:24:04.818994 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Content-Length: 0 Aug 27 02:24:04.818994 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Content-Type: application/json Aug 27 02:24:04.818994 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Host: 10.222.0.61 Aug 27 02:24:04.818994 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Openstack-System-Scope: None Aug 27 02:24:04.818994 dv-cinder-846303-3-smb devstack@n-api.service[120782]: User-Agent: python-urllib3/1.26.11 Aug 27 02:24:04.818994 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Auth-Token: gAAAAABjCX_fjcetv72At26kP1f-v082BhCSV5xlgZbXaPuJ8EYS8H090atd1ocKfAnmKo6n0RNNhFO8b3j2gmx8cG6J2zkjCmp2ZE5hEaSDdn8UUl_V-aNZ3y1z9t3z0VzgiXYt_W8fFtXoo7oturyK69Z4elR4sTNkcI86gzf6gURUnIA8Kic Aug 27 02:24:04.818994 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Domain-Id: None Aug 27 02:24:04.818994 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Domain-Name: None Aug 27 02:24:04.818994 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Identity-Status: Confirmed Aug 27 02:24:04.818994 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Is-Admin-Project: True Aug 27 02:24:04.818994 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Domain-Id: default Aug 27 02:24:04.818994 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Domain-Name: Default Aug 27 02:24:04.818994 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Id: ac7bf59244bc487b84c7dbf9aa7314d2 Aug 27 02:24:04.818994 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1467510534 Aug 27 02:24:04.818994 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Role: member,reader Aug 27 02:24:04.818994 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Roles: member,reader Aug 27 02:24:04.821698 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ac7bf59244bc487b84c7dbf9aa7314d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ac7bf59244bc487b84c7dbf9aa7314d2", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ac7bf59244bc487b84c7dbf9aa7314d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ac7bf59244bc487b84c7dbf9aa7314d2"}]}] Aug 27 02:24:04.821698 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Tenant: tempest-VolumesSnapshotTestJSON-1467510534 Aug 27 02:24:04.821698 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Tenant-Id: ac7bf59244bc487b84c7dbf9aa7314d2 Aug 27 02:24:04.821698 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1467510534 Aug 27 02:24:04.821698 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User: tempest-VolumesSnapshotTestJSON-1467510534-project Aug 27 02:24:04.821698 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Domain-Id: default Aug 27 02:24:04.821698 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Domain-Name: Default Aug 27 02:24:04.821698 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Id: 2f931e726872474dae2b7b6fbb0eb644 Aug 27 02:24:04.821698 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Name: tempest-VolumesSnapshotTestJSON-1467510534-project Aug 27 02:24:04.821698 dv-cinder-846303-3-smb devstack@n-api.service[120782]: method: > Aug 27 02:24:04.821698 dv-cinder-846303-3-smb devstack@n-api.service[120782]: exception: Instance 35d91cb7-f14b-4788-b503-ea9feaee650b could not be found. Aug 27 02:24:04.821698 dv-cinder-846303-3-smb devstack@n-api.service[120782]: action_args: {'id': '35d91cb7-f14b-4788-b503-ea9feaee650b'} Aug 27 02:24:04.827008 dv-cinder-846303-3-smb devstack@n-api.service[120782]: {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:24:04.827008 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:24:04.827008 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:24:04.827008 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:24:04.827008 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:24:04.827008 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:24:04.827008 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:24:04.827008 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:24:04.827008 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:24:04.827008 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:24:04.827008 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35d91cb7-f14b-4788-b503-ea9feaee650b could not be found. Aug 27 02:24:04.827008 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:24:04.827008 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:24:04.827008 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:24:04.827008 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:24:04.827008 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:24:04.827008 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:24:04.827008 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:24:04.827008 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:24:04.827008 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:24:04.828563 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:24:04.828563 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:24:04.828563 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:24:04.828563 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:24:04.828563 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:24:04.828563 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:24:04.828563 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:24:04.828563 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35d91cb7-f14b-4788-b503-ea9feaee650b could not be found. Aug 27 02:24:04.828563 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:24:04.828563 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:24:04.828563 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:24:04.828563 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:24:04.828563 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:24:04.828563 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:24:04.828563 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:24:04.828563 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:24:04.828563 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35d91cb7-f14b-4788-b503-ea9feaee650b could not be found. Aug 27 02:24:04.828563 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:24:04.830094 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-cd37a2ad-100e-44ac-b265-b1b56556e671 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Returning 404 to user: Instance 35d91cb7-f14b-4788-b503-ea9feaee650b could not be found. {{(pid=120782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:24:04.830094 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-cd37a2ad-100e-44ac-b265-b1b56556e671 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] 10.222.0.61 "GET /compute/v2.1/servers/35d91cb7-f14b-4788-b503-ea9feaee650b" status: 404 len: 111 microversion: 2.1 time: 0.047802 Aug 27 02:24:04.830094 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 233/462] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:04 2022] GET /compute/v2.1/servers/35d91cb7-f14b-4788-b503-ea9feaee650b => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:24:05.011859 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-103fa856-4dbc-461b-b8cc-a270636e12ba tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:05.013854 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-103fa856-4dbc-461b-b8cc-a270636e12ba tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] [instance: 49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:05.028657 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-103fa856-4dbc-461b-b8cc-a270636e12ba tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:05.030220 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-103fa856-4dbc-461b-b8cc-a270636e12ba tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:05.031487 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-103fa856-4dbc-461b-b8cc-a270636e12ba tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:05.033160 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-103fa856-4dbc-461b-b8cc-a270636e12ba tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:05.034360 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-103fa856-4dbc-461b-b8cc-a270636e12ba tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:05.035727 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-103fa856-4dbc-461b-b8cc-a270636e12ba tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:05.259852 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-c484d9c9-77a6-472b-a740-c8d3981e2e81 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:05.277489 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-c484d9c9-77a6-472b-a740-c8d3981e2e81 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:05.280684 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-c484d9c9-77a6-472b-a740-c8d3981e2e81 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:05.283177 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-c484d9c9-77a6-472b-a740-c8d3981e2e81 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db" status: 200 len: 1807 microversion: 2.20 time: 0.601881 Aug 27 02:24:05.284624 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 230/463] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:24:04 2022] GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db => generated 1807 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:24:05.295194 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-103fa856-4dbc-461b-b8cc-a270636e12ba tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931dcabba0214e3daa878f31cd1706cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f956d4d27437c830871f6634a3018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:05.312471 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-103fa856-4dbc-461b-b8cc-a270636e12ba tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] 10.222.0.61 "GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8" status: 200 len: 1358 microversion: 2.1 time: 0.307550 Aug 27 02:24:05.314186 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 234/464] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:05 2022] GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8 => generated 1358 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:24:05.712956 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-0972318f-1d96-432d-81d5-6de6834608a8 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:05.714392 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-0972318f-1d96-432d-81d5-6de6834608a8 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] [instance: 9fb59350-4f09-4e20-bddb-ffc9a65897b3] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:05.721952 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0972318f-1d96-432d-81d5-6de6834608a8 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:05.722451 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0972318f-1d96-432d-81d5-6de6834608a8 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:05.722878 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0972318f-1d96-432d-81d5-6de6834608a8 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:05.723604 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0972318f-1d96-432d-81d5-6de6834608a8 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:05.724059 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0972318f-1d96-432d-81d5-6de6834608a8 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:05.724479 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0972318f-1d96-432d-81d5-6de6834608a8 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:05.800379 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-12863cb6-d9e7-4de3-ad64-48d78e98294f tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:05.800976 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-12863cb6-d9e7-4de3-ad64-48d78e98294f tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: d5c72277-dabd-484c-9e20-279b6159516a] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:05.808979 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-12863cb6-d9e7-4de3-ad64-48d78e98294f tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:05.809501 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-12863cb6-d9e7-4de3-ad64-48d78e98294f tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:05.809932 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-12863cb6-d9e7-4de3-ad64-48d78e98294f tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:05.810650 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-12863cb6-d9e7-4de3-ad64-48d78e98294f tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:05.811108 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-12863cb6-d9e7-4de3-ad64-48d78e98294f tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:05.811533 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-12863cb6-d9e7-4de3-ad64-48d78e98294f tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:05.902651 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-12863cb6-d9e7-4de3-ad64-48d78e98294f tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6f819365574091ae344f14e47f487f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa1c411b57d4e72885dac2b4f4dfe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:05.912142 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-12863cb6-d9e7-4de3-ad64-48d78e98294f tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/d5c72277-dabd-484c-9e20-279b6159516a" status: 200 len: 1615 microversion: 2.1 time: 0.116350 Aug 27 02:24:05.912778 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 235/465] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:05 2022] GET /compute/v2.1/servers/d5c72277-dabd-484c-9e20-279b6159516a => generated 1615 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:24:06.143423 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-0972318f-1d96-432d-81d5-6de6834608a8 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f53d57f3544e5a25e1beeddab9af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2d4ae1c228446eb5bfc64d44348fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:06.163864 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-0972318f-1d96-432d-81d5-6de6834608a8 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] 10.222.0.61 "GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3" status: 200 len: 1205 microversion: 2.1 time: 0.454666 Aug 27 02:24:06.165141 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 231/466] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:05 2022] GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3 => generated 1205 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:24:06.346115 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-b1274039-ca09-434e-9bb2-8904c2abbadf tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:06.348378 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-b1274039-ca09-434e-9bb2-8904c2abbadf tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:06.349504 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-7eb7fb07-d1f1-46df-bcc5-f96f9037143d tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:06.350493 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-7eb7fb07-d1f1-46df-bcc5-f96f9037143d tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] [instance: 49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:06.374831 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b1274039-ca09-434e-9bb2-8904c2abbadf tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:06.375637 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b1274039-ca09-434e-9bb2-8904c2abbadf tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:06.376404 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b1274039-ca09-434e-9bb2-8904c2abbadf tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:06.378519 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b1274039-ca09-434e-9bb2-8904c2abbadf tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:06.379684 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b1274039-ca09-434e-9bb2-8904c2abbadf tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:06.380683 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b1274039-ca09-434e-9bb2-8904c2abbadf tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:06.391924 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7eb7fb07-d1f1-46df-bcc5-f96f9037143d tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:06.394602 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7eb7fb07-d1f1-46df-bcc5-f96f9037143d tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:06.401994 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7eb7fb07-d1f1-46df-bcc5-f96f9037143d tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:06.403311 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7eb7fb07-d1f1-46df-bcc5-f96f9037143d tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:06.412002 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7eb7fb07-d1f1-46df-bcc5-f96f9037143d tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:06.418509 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7eb7fb07-d1f1-46df-bcc5-f96f9037143d tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:06.815980 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-b1274039-ca09-434e-9bb2-8904c2abbadf tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:06.839165 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-b1274039-ca09-434e-9bb2-8904c2abbadf tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:06.840982 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-b1274039-ca09-434e-9bb2-8904c2abbadf tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:06.849139 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-b1274039-ca09-434e-9bb2-8904c2abbadf tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db" status: 200 len: 1807 microversion: 2.20 time: 0.521652 Aug 27 02:24:06.852268 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 236/467] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:24:06 2022] GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db => generated 1807 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:24:06.857764 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [req-16e1a6ff-ab3d-4e13-b9a9-fe9275c2fd55 req-79a5f7e6-46a0-4b09-91e1-c22a8f6694a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5c72277-dabd-484c-9e20-279b6159516a", "name": "network-vif-deleted", "tag": "e99da92c-3934-4351-8ad6-ffb344f3377f"}]} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:24:06.870583 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:24:06.873514 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-16e1a6ff-ab3d-4e13-b9a9-fe9275c2fd55 req-79a5f7e6-46a0-4b09-91e1-c22a8f6694a0 service nova] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:06.880866 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-16e1a6ff-ab3d-4e13-b9a9-fe9275c2fd55 req-79a5f7e6-46a0-4b09-91e1-c22a8f6694a0 service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:06.880866 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-16e1a6ff-ab3d-4e13-b9a9-fe9275c2fd55 req-79a5f7e6-46a0-4b09-91e1-c22a8f6694a0 service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:06.892802 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.compute.server_external_events [req-16e1a6ff-ab3d-4e13-b9a9-fe9275c2fd55 req-79a5f7e6-46a0-4b09-91e1-c22a8f6694a0 service nova] Creating event network-vif-deleted:e99da92c-3934-4351-8ad6-ffb344f3377f for instance d5c72277-dabd-484c-9e20-279b6159516a on hv-cinder-84630 Aug 27 02:24:06.903356 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [req-16e1a6ff-ab3d-4e13-b9a9-fe9275c2fd55 req-79a5f7e6-46a0-4b09-91e1-c22a8f6694a0 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049440 Aug 27 02:24:06.904670 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 237/468] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Aug 27 02:24:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:24:06.959417 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-7e3f5516-b3a2-40a3-ace9-617acce56d1c tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:06.961237 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-7e3f5516-b3a2-40a3-ace9-617acce56d1c tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: d5c72277-dabd-484c-9e20-279b6159516a] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:06.981877 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7e3f5516-b3a2-40a3-ace9-617acce56d1c tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:06.985230 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7e3f5516-b3a2-40a3-ace9-617acce56d1c tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:06.986252 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7e3f5516-b3a2-40a3-ace9-617acce56d1c tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:06.987235 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7e3f5516-b3a2-40a3-ace9-617acce56d1c tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:06.988538 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7e3f5516-b3a2-40a3-ace9-617acce56d1c tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:06.989342 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7e3f5516-b3a2-40a3-ace9-617acce56d1c tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:07.043298 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-7eb7fb07-d1f1-46df-bcc5-f96f9037143d tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931dcabba0214e3daa878f31cd1706cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f956d4d27437c830871f6634a3018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:07.067243 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-7eb7fb07-d1f1-46df-bcc5-f96f9037143d tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] 10.222.0.61 "GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8" status: 200 len: 1358 microversion: 2.1 time: 0.724203 Aug 27 02:24:07.068661 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 232/469] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:06 2022] GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8 => generated 1358 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:24:07.197671 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-3897c19a-5de9-4bbd-8803-afc090b7355e tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:07.198937 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-3897c19a-5de9-4bbd-8803-afc090b7355e tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] [instance: 9fb59350-4f09-4e20-bddb-ffc9a65897b3] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:07.216208 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3897c19a-5de9-4bbd-8803-afc090b7355e tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:07.217649 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3897c19a-5de9-4bbd-8803-afc090b7355e tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:07.219853 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3897c19a-5de9-4bbd-8803-afc090b7355e tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:07.223105 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3897c19a-5de9-4bbd-8803-afc090b7355e tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:07.225064 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3897c19a-5de9-4bbd-8803-afc090b7355e tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:07.227989 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3897c19a-5de9-4bbd-8803-afc090b7355e tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:07.236859 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-7e3f5516-b3a2-40a3-ace9-617acce56d1c tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6f819365574091ae344f14e47f487f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa1c411b57d4e72885dac2b4f4dfe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:07.266215 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-7e3f5516-b3a2-40a3-ace9-617acce56d1c tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/d5c72277-dabd-484c-9e20-279b6159516a" status: 200 len: 1615 microversion: 2.1 time: 0.319232 Aug 27 02:24:07.267134 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 238/470] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:06 2022] GET /compute/v2.1/servers/d5c72277-dabd-484c-9e20-279b6159516a => generated 1615 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:24:07.379464 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-3897c19a-5de9-4bbd-8803-afc090b7355e tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f53d57f3544e5a25e1beeddab9af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2d4ae1c228446eb5bfc64d44348fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:07.406137 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-3897c19a-5de9-4bbd-8803-afc090b7355e tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] 10.222.0.61 "GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3" status: 200 len: 1193 microversion: 2.1 time: 0.212057 Aug 27 02:24:07.407219 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 233/471] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:07 2022] GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3 => generated 1193 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:24:07.903117 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-77b6e65f-81ef-44ea-a9e5-8c82df2e3c88 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:07.905459 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-77b6e65f-81ef-44ea-a9e5-8c82df2e3c88 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:07.943625 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-77b6e65f-81ef-44ea-a9e5-8c82df2e3c88 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:07.945092 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-77b6e65f-81ef-44ea-a9e5-8c82df2e3c88 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:07.946239 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-77b6e65f-81ef-44ea-a9e5-8c82df2e3c88 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:07.947814 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-77b6e65f-81ef-44ea-a9e5-8c82df2e3c88 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:07.948889 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-77b6e65f-81ef-44ea-a9e5-8c82df2e3c88 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:07.950025 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-77b6e65f-81ef-44ea-a9e5-8c82df2e3c88 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:08.123276 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-4d8ca2ab-7464-45c1-be99-1bdb7fc7bac2 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:08.124466 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-4d8ca2ab-7464-45c1-be99-1bdb7fc7bac2 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] [instance: 49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:08.175072 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4d8ca2ab-7464-45c1-be99-1bdb7fc7bac2 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:08.176079 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4d8ca2ab-7464-45c1-be99-1bdb7fc7bac2 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:08.177174 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4d8ca2ab-7464-45c1-be99-1bdb7fc7bac2 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:08.178468 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4d8ca2ab-7464-45c1-be99-1bdb7fc7bac2 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:08.186113 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4d8ca2ab-7464-45c1-be99-1bdb7fc7bac2 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:08.186113 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4d8ca2ab-7464-45c1-be99-1bdb7fc7bac2 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:08.475200 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-77b6e65f-81ef-44ea-a9e5-8c82df2e3c88 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:08.507252 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-77b6e65f-81ef-44ea-a9e5-8c82df2e3c88 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:08.512302 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-77b6e65f-81ef-44ea-a9e5-8c82df2e3c88 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:08.517622 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-77b6e65f-81ef-44ea-a9e5-8c82df2e3c88 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db" status: 200 len: 1807 microversion: 2.20 time: 0.622248 Aug 27 02:24:08.547149 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 239/472] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:24:07 2022] GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db => generated 1807 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:24:08.564114 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-f14b0f7b-5aba-4a04-b717-50790296f4c9 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:08.565995 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-f14b0f7b-5aba-4a04-b717-50790296f4c9 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: d5c72277-dabd-484c-9e20-279b6159516a] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:08.584922 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f14b0f7b-5aba-4a04-b717-50790296f4c9 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:08.586290 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f14b0f7b-5aba-4a04-b717-50790296f4c9 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:08.587359 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f14b0f7b-5aba-4a04-b717-50790296f4c9 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:08.588884 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f14b0f7b-5aba-4a04-b717-50790296f4c9 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:08.589799 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f14b0f7b-5aba-4a04-b717-50790296f4c9 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:08.591918 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f14b0f7b-5aba-4a04-b717-50790296f4c9 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:08.767403 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f14b0f7b-5aba-4a04-b717-50790296f4c9 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:08.767930 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f14b0f7b-5aba-4a04-b717-50790296f4c9 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:08.768692 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f14b0f7b-5aba-4a04-b717-50790296f4c9 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:08.769295 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.objects.instance [None req-f14b0f7b-5aba-4a04-b717-50790296f4c9 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lazy-loading 'fault' on Instance uuid d5c72277-dabd-484c-9e20-279b6159516a {{(pid=120782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:24:08.934966 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-f14b0f7b-5aba-4a04-b717-50790296f4c9 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6f819365574091ae344f14e47f487f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa1c411b57d4e72885dac2b4f4dfe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:08.955600 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-f14b0f7b-5aba-4a04-b717-50790296f4c9 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/d5c72277-dabd-484c-9e20-279b6159516a" status: 200 len: 1331 microversion: 2.1 time: 0.401530 Aug 27 02:24:08.975686 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 240/473] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:08 2022] GET /compute/v2.1/servers/d5c72277-dabd-484c-9e20-279b6159516a => generated 1331 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:24:08.989795 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-dd16da74-0a9a-4aaf-a2af-aeceac763860 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:08.992267 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-4d8ca2ab-7464-45c1-be99-1bdb7fc7bac2 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931dcabba0214e3daa878f31cd1706cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f956d4d27437c830871f6634a3018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:08.993997 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-dd16da74-0a9a-4aaf-a2af-aeceac763860 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] [instance: 9fb59350-4f09-4e20-bddb-ffc9a65897b3] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:09.007781 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-dd16da74-0a9a-4aaf-a2af-aeceac763860 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:09.008564 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-dd16da74-0a9a-4aaf-a2af-aeceac763860 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:09.009870 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-dd16da74-0a9a-4aaf-a2af-aeceac763860 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:09.010564 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-4d8ca2ab-7464-45c1-be99-1bdb7fc7bac2 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] 10.222.0.61 "GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8" status: 200 len: 1358 microversion: 2.1 time: 0.903976 Aug 27 02:24:09.011529 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-dd16da74-0a9a-4aaf-a2af-aeceac763860 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:09.012166 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-dd16da74-0a9a-4aaf-a2af-aeceac763860 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:09.012811 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-dd16da74-0a9a-4aaf-a2af-aeceac763860 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:09.013047 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 234/474] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:08 2022] GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8 => generated 1358 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:24:09.574296 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-ad8ac584-c68a-45e7-bd0b-c9c2fd0790d2 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:09.575920 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-ad8ac584-c68a-45e7-bd0b-c9c2fd0790d2 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:09.595083 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ad8ac584-c68a-45e7-bd0b-c9c2fd0790d2 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:09.598406 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ad8ac584-c68a-45e7-bd0b-c9c2fd0790d2 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:09.601200 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ad8ac584-c68a-45e7-bd0b-c9c2fd0790d2 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:09.605168 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ad8ac584-c68a-45e7-bd0b-c9c2fd0790d2 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:09.607960 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ad8ac584-c68a-45e7-bd0b-c9c2fd0790d2 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:09.614782 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ad8ac584-c68a-45e7-bd0b-c9c2fd0790d2 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:09.769773 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-dd16da74-0a9a-4aaf-a2af-aeceac763860 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f53d57f3544e5a25e1beeddab9af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2d4ae1c228446eb5bfc64d44348fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:09.824328 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-dd16da74-0a9a-4aaf-a2af-aeceac763860 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] 10.222.0.61 "GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3" status: 200 len: 1260 microversion: 2.1 time: 0.845921 Aug 27 02:24:09.828786 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 241/475] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:08 2022] GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3 => generated 1260 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:24:09.954296 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [req-62598b96-99db-4d46-b826-831eb1f98e76 req-acf374f5-1182-4b1c-923c-9ef3c959c474 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fb59350-4f09-4e20-bddb-ffc9a65897b3", "tag": "b6386749-9042-42f7-933e-fe24b60012ef"}]} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:24:09.982539 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-62598b96-99db-4d46-b826-831eb1f98e76 req-acf374f5-1182-4b1c-923c-9ef3c959c474 service nova] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:09.983032 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-62598b96-99db-4d46-b826-831eb1f98e76 req-acf374f5-1182-4b1c-923c-9ef3c959c474 service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:09.995903 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-62598b96-99db-4d46-b826-831eb1f98e76 req-acf374f5-1182-4b1c-923c-9ef3c959c474 service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:10.029775 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.compute.server_external_events [req-62598b96-99db-4d46-b826-831eb1f98e76 req-acf374f5-1182-4b1c-923c-9ef3c959c474 service nova] Creating event network-changed:b6386749-9042-42f7-933e-fe24b60012ef for instance 9fb59350-4f09-4e20-bddb-ffc9a65897b3 on hv-cinder-84630 Aug 27 02:24:10.055339 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [req-62598b96-99db-4d46-b826-831eb1f98e76 req-acf374f5-1182-4b1c-923c-9ef3c959c474 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108410 Aug 27 02:24:10.056141 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 242/476] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Aug 27 02:24:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:24:10.078210 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-baacade8-f6c2-4408-9a8a-07e2a082eb7c tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:10.079362 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-baacade8-f6c2-4408-9a8a-07e2a082eb7c tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: d5c72277-dabd-484c-9e20-279b6159516a] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:10.103913 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-baacade8-f6c2-4408-9a8a-07e2a082eb7c tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:10.108341 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-baacade8-f6c2-4408-9a8a-07e2a082eb7c tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:10.109071 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-baacade8-f6c2-4408-9a8a-07e2a082eb7c tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:10.109872 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-baacade8-f6c2-4408-9a8a-07e2a082eb7c tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:10.110351 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-baacade8-f6c2-4408-9a8a-07e2a082eb7c tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:10.110775 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-baacade8-f6c2-4408-9a8a-07e2a082eb7c tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:10.120354 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell1:SELECT=100 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:24:10.151571 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.wsgi [None req-baacade8-f6c2-4408-9a8a-07e2a082eb7c tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] HTTP exception thrown: Instance d5c72277-dabd-484c-9e20-279b6159516a could not be found. Aug 27 02:24:10.153342 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-baacade8-f6c2-4408-9a8a-07e2a082eb7c tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Request method failure captured: Aug 27 02:24:10.153342 dv-cinder-846303-3-smb devstack@n-api.service[120782]: request: GET /compute/v2.1/servers/d5c72277-dabd-484c-9e20-279b6159516a HTTP/1.1 Aug 27 02:24:10.153342 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Accept: application/json Aug 27 02:24:10.153342 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Accept-Encoding: identity Aug 27 02:24:10.153342 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Connection: close Aug 27 02:24:10.153342 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Content-Length: 0 Aug 27 02:24:10.153342 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Content-Type: application/json Aug 27 02:24:10.153342 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Host: 10.222.0.61 Aug 27 02:24:10.153342 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Openstack-System-Scope: None Aug 27 02:24:10.153342 dv-cinder-846303-3-smb devstack@n-api.service[120782]: User-Agent: python-urllib3/1.26.11 Aug 27 02:24:10.153342 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Auth-Token: gAAAAABjCX-GZMxBoDm0UEKrtF9w1zn8zf5k_pRKs9w1w8QBRmamyePi9gdcvRwYzK044f89BKz1wZ6FALfNLv1C6uDnz_VZDZcPY_z2HcyDI5nmMGMvL5rG2v4zh3O1IrszVG_kNPPcMoviX7QaOQhXuRqD1X6DsEJwS6gyWrQ-SPSaYeWVQOw Aug 27 02:24:10.153342 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Domain-Id: None Aug 27 02:24:10.153342 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Domain-Name: None Aug 27 02:24:10.153342 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Identity-Status: Confirmed Aug 27 02:24:10.153342 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Is-Admin-Project: True Aug 27 02:24:10.153342 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Domain-Id: default Aug 27 02:24:10.153342 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Domain-Name: Default Aug 27 02:24:10.153342 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Id: 8aa1c411b57d4e72885dac2b4f4dfe7a Aug 27 02:24:10.153342 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Name: tempest-AttachVolumeNegativeTest-799378516 Aug 27 02:24:10.153342 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Role: member,reader Aug 27 02:24:10.153342 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Roles: member,reader Aug 27 02:24:10.154930 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/8aa1c411b57d4e72885dac2b4f4dfe7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_8aa1c411b57d4e72885dac2b4f4dfe7a", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8aa1c411b57d4e72885dac2b4f4dfe7a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8aa1c411b57d4e72885dac2b4f4dfe7a"}]}] Aug 27 02:24:10.154930 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Tenant: tempest-AttachVolumeNegativeTest-799378516 Aug 27 02:24:10.154930 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Tenant-Id: 8aa1c411b57d4e72885dac2b4f4dfe7a Aug 27 02:24:10.154930 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-799378516 Aug 27 02:24:10.154930 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User: tempest-AttachVolumeNegativeTest-799378516-project Aug 27 02:24:10.154930 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Domain-Id: default Aug 27 02:24:10.154930 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Domain-Name: Default Aug 27 02:24:10.154930 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Id: 4a6f819365574091ae344f14e47f487f Aug 27 02:24:10.154930 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Name: tempest-AttachVolumeNegativeTest-799378516-project Aug 27 02:24:10.154930 dv-cinder-846303-3-smb devstack@n-api.service[120782]: method: > Aug 27 02:24:10.154930 dv-cinder-846303-3-smb devstack@n-api.service[120782]: exception: Instance d5c72277-dabd-484c-9e20-279b6159516a could not be found. Aug 27 02:24:10.154930 dv-cinder-846303-3-smb devstack@n-api.service[120782]: action_args: {'id': 'd5c72277-dabd-484c-9e20-279b6159516a'} Aug 27 02:24:10.155693 dv-cinder-846303-3-smb devstack@n-api.service[120782]: {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:24:10.155693 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:24:10.155693 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:24:10.155693 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:24:10.155693 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:24:10.155693 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:24:10.155693 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:24:10.155693 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:24:10.155693 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:24:10.155693 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:24:10.155693 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5c72277-dabd-484c-9e20-279b6159516a could not be found. Aug 27 02:24:10.155693 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:24:10.155693 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:24:10.155693 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:24:10.155693 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:24:10.155693 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:24:10.155693 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:24:10.155693 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:24:10.155693 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:24:10.155693 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:24:10.157026 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:24:10.157026 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:24:10.157026 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:24:10.157026 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:24:10.157026 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:24:10.157026 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:24:10.157026 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:24:10.157026 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5c72277-dabd-484c-9e20-279b6159516a could not be found. Aug 27 02:24:10.157026 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:24:10.157026 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:24:10.157026 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:24:10.157026 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:24:10.157026 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:24:10.157026 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:24:10.157026 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:24:10.157026 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:24:10.157026 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5c72277-dabd-484c-9e20-279b6159516a could not be found. Aug 27 02:24:10.157026 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:24:10.168194 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-baacade8-f6c2-4408-9a8a-07e2a082eb7c tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Returning 404 to user: Instance d5c72277-dabd-484c-9e20-279b6159516a could not be found. {{(pid=120782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:24:10.174515 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-baacade8-f6c2-4408-9a8a-07e2a082eb7c tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/d5c72277-dabd-484c-9e20-279b6159516a" status: 404 len: 111 microversion: 2.1 time: 0.113561 Aug 27 02:24:10.181169 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 243/477] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:10 2022] GET /compute/v2.1/servers/d5c72277-dabd-484c-9e20-279b6159516a => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:24:10.203097 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-d42fb2be-56d2-4635-8be4-6c79018f6b89 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:10.204767 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-d42fb2be-56d2-4635-8be4-6c79018f6b89 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] [instance: 49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:10.233772 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d42fb2be-56d2-4635-8be4-6c79018f6b89 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:10.234270 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d42fb2be-56d2-4635-8be4-6c79018f6b89 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:10.239020 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d42fb2be-56d2-4635-8be4-6c79018f6b89 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:10.240901 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d42fb2be-56d2-4635-8be4-6c79018f6b89 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:10.241639 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d42fb2be-56d2-4635-8be4-6c79018f6b89 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:10.242234 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d42fb2be-56d2-4635-8be4-6c79018f6b89 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:10.272154 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-ad8ac584-c68a-45e7-bd0b-c9c2fd0790d2 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:10.287345 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-ad8ac584-c68a-45e7-bd0b-c9c2fd0790d2 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:10.292200 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-ad8ac584-c68a-45e7-bd0b-c9c2fd0790d2 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:10.296940 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-ad8ac584-c68a-45e7-bd0b-c9c2fd0790d2 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db" status: 200 len: 1807 microversion: 2.20 time: 0.726832 Aug 27 02:24:10.304258 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 235/478] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:24:09 2022] GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db => generated 1807 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:24:10.315816 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-d9a9abec-f283-4d78-a23d-6e7dfb4ac456 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1107517460", "imageRef": "7d45cdd6-750f-40c7-9475-f7bf12fcb204", "flavorRef": "452", "networks": [{"uuid": "a8404694-5630-4006-bcb7-562e0f1845bc"}]}} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:24:10.462781 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.network.neutron [None req-d9a9abec-f283-4d78-a23d-6e7dfb4ac456 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] validate_networks() for [('a8404694-5630-4006-bcb7-562e0f1845bc', None, None, None, None, None)] {{(pid=120783) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:24:10.639410 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-d42fb2be-56d2-4635-8be4-6c79018f6b89 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931dcabba0214e3daa878f31cd1706cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f956d4d27437c830871f6634a3018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:10.654840 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-d42fb2be-56d2-4635-8be4-6c79018f6b89 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] 10.222.0.61 "GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8" status: 200 len: 1358 microversion: 2.1 time: 0.471046 Aug 27 02:24:10.655910 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 244/479] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:10 2022] GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8 => generated 1358 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:24:10.663512 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-7f5e0831-44f4-4da1-96b5-bc8312f69bff tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '.version_select at 0x7fd808488a60>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:10.720997 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-7f5e0831-44f4-4da1-96b5-bc8312f69bff tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-575753538" status: 202 len: 0 microversion: 2.1 time: 0.063530 Aug 27 02:24:10.728825 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 245/480] 10.222.0.61 () {58 vars in 1218 bytes} [Sat Aug 27 02:24:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-575753538 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:24:10.739467 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-af2c022f-11bc-4d56-8bc7-bb697d3533a6 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:10.740206 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-af2c022f-11bc-4d56-8bc7-bb697d3533a6 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 4fedf0d1-cc1c-4947-b92e-dcb4454889d1] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:10.767552 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-af2c022f-11bc-4d56-8bc7-bb697d3533a6 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:10.768261 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-af2c022f-11bc-4d56-8bc7-bb697d3533a6 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:10.768708 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-af2c022f-11bc-4d56-8bc7-bb697d3533a6 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:10.769494 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-af2c022f-11bc-4d56-8bc7-bb697d3533a6 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:10.769955 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-af2c022f-11bc-4d56-8bc7-bb697d3533a6 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:10.770381 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-af2c022f-11bc-4d56-8bc7-bb697d3533a6 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:11.089500 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.objects.instance [None req-af2c022f-11bc-4d56-8bc7-bb697d3533a6 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lazy-loading 'services' on Instance uuid 4fedf0d1-cc1c-4947-b92e-dcb4454889d1 {{(pid=120782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:24:11.159176 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.virt.hardware [None req-d9a9abec-f283-4d78-a23d-6e7dfb4ac456 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Flavor limits 0:0:0 {{(pid=120783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:24:11.159897 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.virt.hardware [None req-d9a9abec-f283-4d78-a23d-6e7dfb4ac456 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Image limits 0:0:0 {{(pid=120783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:24:11.160265 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.virt.hardware [None req-d9a9abec-f283-4d78-a23d-6e7dfb4ac456 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Flavor pref 0:0:0 {{(pid=120783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:24:11.160927 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.virt.hardware [None req-d9a9abec-f283-4d78-a23d-6e7dfb4ac456 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Image pref 0:0:0 {{(pid=120783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:24:11.161617 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.virt.hardware [None req-d9a9abec-f283-4d78-a23d-6e7dfb4ac456 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:24:11.199364 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d9a9abec-f283-4d78-a23d-6e7dfb4ac456 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:11.201363 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d9a9abec-f283-4d78-a23d-6e7dfb4ac456 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:11.202848 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d9a9abec-f283-4d78-a23d-6e7dfb4ac456 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:11.206849 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d9a9abec-f283-4d78-a23d-6e7dfb4ac456 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:11.207770 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d9a9abec-f283-4d78-a23d-6e7dfb4ac456 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:11.208220 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d9a9abec-f283-4d78-a23d-6e7dfb4ac456 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:11.240143 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:24:11.268020 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.quota [None req-d9a9abec-f283-4d78-a23d-6e7dfb4ac456 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Getting quotas for project ac7bf59244bc487b84c7dbf9aa7314d2. Resources: {'instances', 'ram', 'cores'} {{(pid=120783) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:24:11.289009 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.quota [None req-d9a9abec-f283-4d78-a23d-6e7dfb4ac456 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Getting quotas for user 2f931e726872474dae2b7b6fbb0eb644 and project ac7bf59244bc487b84c7dbf9aa7314d2. Resources: {'instances', 'ram', 'cores'} {{(pid=120783) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:24:11.301591 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-af2c022f-11bc-4d56-8bc7-bb697d3533a6 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "DELETE /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1/os-volume_attachments/2f651749-2cc8-4776-8a0e-32bd390908ba" status: 202 len: 0 microversion: 2.1 time: 0.565456 Aug 27 02:24:11.303768 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 246/481] 10.222.0.61 () {58 vars in 1416 bytes} [Sat Aug 27 02:24:10 2022] DELETE /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1/os-volume_attachments/2f651749-2cc8-4776-8a0e-32bd390908ba => generated 0 bytes in 574 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:24:11.322277 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-f14ea4fc-8e76-4497-8944-0eb962157b72 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:11.323111 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-f14ea4fc-8e76-4497-8944-0eb962157b72 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] [instance: 9fb59350-4f09-4e20-bddb-ffc9a65897b3] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:11.348510 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-d9a9abec-f283-4d78-a23d-6e7dfb4ac456 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Going to run 1 instances... {{(pid=120783) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:24:11.349891 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f14ea4fc-8e76-4497-8944-0eb962157b72 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:11.352656 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f14ea4fc-8e76-4497-8944-0eb962157b72 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:11.354347 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f14ea4fc-8e76-4497-8944-0eb962157b72 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:11.354795 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-d9a9abec-f283-4d78-a23d-6e7dfb4ac456 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] [instance: 4e641be3-227d-43c1-aa50-ecf2b89529c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7d45cdd6-750f-40c7-9475-f7bf12fcb204',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120783) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:24:11.358376 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f14ea4fc-8e76-4497-8944-0eb962157b72 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:11.359008 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f14ea4fc-8e76-4497-8944-0eb962157b72 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:11.359527 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f14ea4fc-8e76-4497-8944-0eb962157b72 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:11.542776 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-d9a9abec-f283-4d78-a23d-6e7dfb4ac456 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.236638 Aug 27 02:24:11.549627 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 236/482] 10.222.0.61 () {60 vars in 1147 bytes} [Sat Aug 27 02:24:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1244 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:24:11.573540 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-138150f6-c049-4f4e-babc-e06b9612a4cc tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:11.574511 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-138150f6-c049-4f4e-babc-e06b9612a4cc tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:11.599849 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-138150f6-c049-4f4e-babc-e06b9612a4cc tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:11.600849 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-138150f6-c049-4f4e-babc-e06b9612a4cc tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:11.601737 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-138150f6-c049-4f4e-babc-e06b9612a4cc tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:11.616389 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-138150f6-c049-4f4e-babc-e06b9612a4cc tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:11.621476 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-138150f6-c049-4f4e-babc-e06b9612a4cc tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:11.622526 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-138150f6-c049-4f4e-babc-e06b9612a4cc tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:11.832625 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-f14ea4fc-8e76-4497-8944-0eb962157b72 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f53d57f3544e5a25e1beeddab9af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2d4ae1c228446eb5bfc64d44348fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:11.845094 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-f14ea4fc-8e76-4497-8944-0eb962157b72 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] 10.222.0.61 "GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3" status: 200 len: 1260 microversion: 2.1 time: 0.536326 Aug 27 02:24:11.858921 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 247/483] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:11 2022] GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3 => generated 1260 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:24:11.865796 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-e98d0882-921a-4666-821d-ca61468c60d8 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:11.866599 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-e98d0882-921a-4666-821d-ca61468c60d8 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] [instance: 4e641be3-227d-43c1-aa50-ecf2b89529c9] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:11.952828 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-e98d0882-921a-4666-821d-ca61468c60d8 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f931e726872474dae2b7b6fbb0eb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7bf59244bc487b84c7dbf9aa7314d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:11.963801 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-e98d0882-921a-4666-821d-ca61468c60d8 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] 10.222.0.61 "GET /compute/v2.1/servers/4e641be3-227d-43c1-aa50-ecf2b89529c9" status: 200 len: 1219 microversion: 2.1 time: 0.103610 Aug 27 02:24:11.979815 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 248/484] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:11 2022] GET /compute/v2.1/servers/4e641be3-227d-43c1-aa50-ecf2b89529c9 => generated 1219 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:24:11.986481 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-0b681ffd-4d0d-43db-908d-9287dfb3a4d7 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:11.987536 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-0b681ffd-4d0d-43db-908d-9287dfb3a4d7 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] [instance: 49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:11.996096 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0b681ffd-4d0d-43db-908d-9287dfb3a4d7 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:11.996859 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0b681ffd-4d0d-43db-908d-9287dfb3a4d7 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:11.997511 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0b681ffd-4d0d-43db-908d-9287dfb3a4d7 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:11.998407 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0b681ffd-4d0d-43db-908d-9287dfb3a4d7 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:11.999710 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0b681ffd-4d0d-43db-908d-9287dfb3a4d7 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:12.000301 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0b681ffd-4d0d-43db-908d-9287dfb3a4d7 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:12.261225 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-0b681ffd-4d0d-43db-908d-9287dfb3a4d7 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931dcabba0214e3daa878f31cd1706cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f956d4d27437c830871f6634a3018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:12.273274 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-0b681ffd-4d0d-43db-908d-9287dfb3a4d7 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] 10.222.0.61 "GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8" status: 200 len: 1358 microversion: 2.1 time: 0.291629 Aug 27 02:24:12.274718 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 249/485] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:11 2022] GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8 => generated 1358 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:24:12.319968 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [req-6ec275a8-0604-4500-94ca-5fb6d09fb2d1 req-0abcd870-db1b-4957-ac96-b0c5ad82c357 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8", "name": "network-vif-plugged", "status": "completed", "tag": "d60d4774-8401-4c3b-b403-1555799f9a3f"}]} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:24:12.356932 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-6ec275a8-0604-4500-94ca-5fb6d09fb2d1 req-0abcd870-db1b-4957-ac96-b0c5ad82c357 service nova] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:12.360504 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-6ec275a8-0604-4500-94ca-5fb6d09fb2d1 req-0abcd870-db1b-4957-ac96-b0c5ad82c357 service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:12.364486 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-6ec275a8-0604-4500-94ca-5fb6d09fb2d1 req-0abcd870-db1b-4957-ac96-b0c5ad82c357 service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:12.427098 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.compute.server_external_events [req-6ec275a8-0604-4500-94ca-5fb6d09fb2d1 req-0abcd870-db1b-4957-ac96-b0c5ad82c357 service nova] Creating event network-vif-plugged:d60d4774-8401-4c3b-b403-1555799f9a3f for instance 49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8 on hv-cinder-84630 Aug 27 02:24:12.478045 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [req-6ec275a8-0604-4500-94ca-5fb6d09fb2d1 req-0abcd870-db1b-4957-ac96-b0c5ad82c357 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165009 Aug 27 02:24:12.480533 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 250/486] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Aug 27 02:24:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:24:12.754759 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-138150f6-c049-4f4e-babc-e06b9612a4cc tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:12.770892 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-138150f6-c049-4f4e-babc-e06b9612a4cc tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:12.773084 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-138150f6-c049-4f4e-babc-e06b9612a4cc tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:12.775441 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-138150f6-c049-4f4e-babc-e06b9612a4cc tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db" status: 200 len: 1807 microversion: 2.20 time: 1.215380 Aug 27 02:24:12.776344 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 237/487] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:24:11 2022] GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db => generated 1807 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:24:12.875279 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-eff385c3-43a0-4217-a696-b7a9841760a6 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:12.882943 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-eff385c3-43a0-4217-a696-b7a9841760a6 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] [instance: 9fb59350-4f09-4e20-bddb-ffc9a65897b3] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:12.896417 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-eff385c3-43a0-4217-a696-b7a9841760a6 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:12.897370 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-eff385c3-43a0-4217-a696-b7a9841760a6 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:12.898293 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-eff385c3-43a0-4217-a696-b7a9841760a6 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:12.900202 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-eff385c3-43a0-4217-a696-b7a9841760a6 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:12.900651 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-eff385c3-43a0-4217-a696-b7a9841760a6 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:12.901522 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-eff385c3-43a0-4217-a696-b7a9841760a6 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:12.987652 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-fda86de7-ef3a-4492-bb6e-519f87c7e0d1 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:12.988607 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-fda86de7-ef3a-4492-bb6e-519f87c7e0d1 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] [instance: 4e641be3-227d-43c1-aa50-ecf2b89529c9] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:13.028343 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fda86de7-ef3a-4492-bb6e-519f87c7e0d1 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:13.028790 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fda86de7-ef3a-4492-bb6e-519f87c7e0d1 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:13.029587 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fda86de7-ef3a-4492-bb6e-519f87c7e0d1 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:13.031289 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fda86de7-ef3a-4492-bb6e-519f87c7e0d1 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:13.032156 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fda86de7-ef3a-4492-bb6e-519f87c7e0d1 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:13.033061 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fda86de7-ef3a-4492-bb6e-519f87c7e0d1 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:13.039008 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:24:13.139349 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-fda86de7-ef3a-4492-bb6e-519f87c7e0d1 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f931e726872474dae2b7b6fbb0eb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7bf59244bc487b84c7dbf9aa7314d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:13.151816 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-fda86de7-ef3a-4492-bb6e-519f87c7e0d1 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] 10.222.0.61 "GET /compute/v2.1/servers/4e641be3-227d-43c1-aa50-ecf2b89529c9" status: 200 len: 1223 microversion: 2.1 time: 0.168393 Aug 27 02:24:13.162129 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 238/488] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:12 2022] GET /compute/v2.1/servers/4e641be3-227d-43c1-aa50-ecf2b89529c9 => generated 1223 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:24:13.173111 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-a3d4bcb3-346d-4f9a-8ba7-d30ada0bff8d tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:13.174114 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-a3d4bcb3-346d-4f9a-8ba7-d30ada0bff8d tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: 268d786c-398a-4305-85ac-545fa3b4370b] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:13.181673 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a3d4bcb3-346d-4f9a-8ba7-d30ada0bff8d tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:13.182608 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a3d4bcb3-346d-4f9a-8ba7-d30ada0bff8d tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:13.183279 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a3d4bcb3-346d-4f9a-8ba7-d30ada0bff8d tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:13.184320 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a3d4bcb3-346d-4f9a-8ba7-d30ada0bff8d tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:13.185022 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a3d4bcb3-346d-4f9a-8ba7-d30ada0bff8d tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:13.185693 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a3d4bcb3-346d-4f9a-8ba7-d30ada0bff8d tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:13.268764 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-eff385c3-43a0-4217-a696-b7a9841760a6 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f53d57f3544e5a25e1beeddab9af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2d4ae1c228446eb5bfc64d44348fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:13.282454 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-eff385c3-43a0-4217-a696-b7a9841760a6 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] 10.222.0.61 "GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3" status: 200 len: 1260 microversion: 2.1 time: 0.414526 Aug 27 02:24:13.284012 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 251/489] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:12 2022] GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3 => generated 1260 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:24:13.342649 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-3225dea7-4660-4486-afd0-32cc8346f272 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:13.348591 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-3225dea7-4660-4486-afd0-32cc8346f272 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] [instance: 49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:13.375487 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3225dea7-4660-4486-afd0-32cc8346f272 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:13.376292 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3225dea7-4660-4486-afd0-32cc8346f272 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:13.382162 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3225dea7-4660-4486-afd0-32cc8346f272 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:13.392664 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3225dea7-4660-4486-afd0-32cc8346f272 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:13.393832 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3225dea7-4660-4486-afd0-32cc8346f272 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:13.394574 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3225dea7-4660-4486-afd0-32cc8346f272 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:13.430127 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.objects.instance [None req-a3d4bcb3-346d-4f9a-8ba7-d30ada0bff8d tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lazy-loading 'services' on Instance uuid 268d786c-398a-4305-85ac-545fa3b4370b {{(pid=120783) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:24:13.686427 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-a3d4bcb3-346d-4f9a-8ba7-d30ada0bff8d tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "DELETE /compute/v2.1/servers/268d786c-398a-4305-85ac-545fa3b4370b/os-volume_attachments/a6f9a924-9d70-4cd3-8d74-8de7e1d35caa" status: 202 len: 0 microversion: 2.1 time: 0.522554 Aug 27 02:24:13.687058 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 239/490] 10.222.0.61 () {58 vars in 1416 bytes} [Sat Aug 27 02:24:13 2022] DELETE /compute/v2.1/servers/268d786c-398a-4305-85ac-545fa3b4370b/os-volume_attachments/a6f9a924-9d70-4cd3-8d74-8de7e1d35caa => generated 0 bytes in 524 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:24:13.698554 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-73869404-a34d-4ee5-aac3-ab31e1252a2a tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:13.711621 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-73869404-a34d-4ee5-aac3-ab31e1252a2a tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: 268d786c-398a-4305-85ac-545fa3b4370b] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:13.721213 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-3225dea7-4660-4486-afd0-32cc8346f272 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931dcabba0214e3daa878f31cd1706cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f956d4d27437c830871f6634a3018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:13.725153 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-73869404-a34d-4ee5-aac3-ab31e1252a2a tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:13.726075 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-73869404-a34d-4ee5-aac3-ab31e1252a2a tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:13.728903 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-73869404-a34d-4ee5-aac3-ab31e1252a2a tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:13.729936 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-73869404-a34d-4ee5-aac3-ab31e1252a2a tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:13.730621 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-73869404-a34d-4ee5-aac3-ab31e1252a2a tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:13.733184 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-73869404-a34d-4ee5-aac3-ab31e1252a2a tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:13.741246 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-3225dea7-4660-4486-afd0-32cc8346f272 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] 10.222.0.61 "GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8" status: 200 len: 1358 microversion: 2.1 time: 0.446576 Aug 27 02:24:13.753425 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 252/491] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:13 2022] GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8 => generated 1358 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:24:13.804728 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-13b9adbe-1ab2-459f-9d14-fdc5333024d6 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:13.805226 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-13b9adbe-1ab2-459f-9d14-fdc5333024d6 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:13.828410 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-13b9adbe-1ab2-459f-9d14-fdc5333024d6 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:13.829121 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-13b9adbe-1ab2-459f-9d14-fdc5333024d6 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:13.833141 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-13b9adbe-1ab2-459f-9d14-fdc5333024d6 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:13.834522 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-13b9adbe-1ab2-459f-9d14-fdc5333024d6 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:13.835241 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-13b9adbe-1ab2-459f-9d14-fdc5333024d6 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:13.836027 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-13b9adbe-1ab2-459f-9d14-fdc5333024d6 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:13.845616 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-73869404-a34d-4ee5-aac3-ab31e1252a2a tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/268d786c-398a-4305-85ac-545fa3b4370b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.151736 Aug 27 02:24:13.846447 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 240/492] 10.222.0.61 () {58 vars in 1302 bytes} [Sat Aug 27 02:24:13 2022] GET /compute/v2.1/servers/268d786c-398a-4305-85ac-545fa3b4370b/os-volume_attachments => generated 197 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:24:14.117325 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-13b9adbe-1ab2-459f-9d14-fdc5333024d6 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:14.131414 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-13b9adbe-1ab2-459f-9d14-fdc5333024d6 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:14.133851 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-13b9adbe-1ab2-459f-9d14-fdc5333024d6 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:14.135760 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-13b9adbe-1ab2-459f-9d14-fdc5333024d6 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db" status: 200 len: 1807 microversion: 2.20 time: 0.335966 Aug 27 02:24:14.136550 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 253/493] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:24:13 2022] GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db => generated 1807 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:24:14.178205 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-487f6b31-ed6a-43ca-b6c2-40286e1819d9 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:14.179097 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-487f6b31-ed6a-43ca-b6c2-40286e1819d9 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] [instance: 4e641be3-227d-43c1-aa50-ecf2b89529c9] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:14.188514 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-487f6b31-ed6a-43ca-b6c2-40286e1819d9 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:14.189623 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-487f6b31-ed6a-43ca-b6c2-40286e1819d9 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:14.190789 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-487f6b31-ed6a-43ca-b6c2-40286e1819d9 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:14.192341 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-487f6b31-ed6a-43ca-b6c2-40286e1819d9 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:14.193343 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-487f6b31-ed6a-43ca-b6c2-40286e1819d9 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:14.194442 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-487f6b31-ed6a-43ca-b6c2-40286e1819d9 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:14.294066 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-487f6b31-ed6a-43ca-b6c2-40286e1819d9 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f931e726872474dae2b7b6fbb0eb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7bf59244bc487b84c7dbf9aa7314d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:14.309418 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-4b8a753c-45c7-49a1-8821-77158005a498 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:14.310526 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-4b8a753c-45c7-49a1-8821-77158005a498 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] [instance: 9fb59350-4f09-4e20-bddb-ffc9a65897b3] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:14.311258 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-487f6b31-ed6a-43ca-b6c2-40286e1819d9 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] 10.222.0.61 "GET /compute/v2.1/servers/4e641be3-227d-43c1-aa50-ecf2b89529c9" status: 200 len: 1223 microversion: 2.1 time: 0.137456 Aug 27 02:24:14.312259 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 241/494] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:14 2022] GET /compute/v2.1/servers/4e641be3-227d-43c1-aa50-ecf2b89529c9 => generated 1223 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:24:14.322671 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4b8a753c-45c7-49a1-8821-77158005a498 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:14.323885 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4b8a753c-45c7-49a1-8821-77158005a498 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:14.324859 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4b8a753c-45c7-49a1-8821-77158005a498 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:14.326678 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4b8a753c-45c7-49a1-8821-77158005a498 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:14.327884 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4b8a753c-45c7-49a1-8821-77158005a498 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:14.328958 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4b8a753c-45c7-49a1-8821-77158005a498 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:14.584899 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-4b8a753c-45c7-49a1-8821-77158005a498 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f53d57f3544e5a25e1beeddab9af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2d4ae1c228446eb5bfc64d44348fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:14.595899 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-4b8a753c-45c7-49a1-8821-77158005a498 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] 10.222.0.61 "GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3" status: 200 len: 1260 microversion: 2.1 time: 0.293920 Aug 27 02:24:14.596906 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 254/495] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:14 2022] GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3 => generated 1260 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:24:14.768991 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-0319265f-f33b-4a8d-b940-70850db2df51 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:14.770030 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-0319265f-f33b-4a8d-b940-70850db2df51 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] [instance: 49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:14.778517 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0319265f-f33b-4a8d-b940-70850db2df51 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:14.779289 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0319265f-f33b-4a8d-b940-70850db2df51 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:14.779973 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0319265f-f33b-4a8d-b940-70850db2df51 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:14.781172 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0319265f-f33b-4a8d-b940-70850db2df51 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:14.781972 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0319265f-f33b-4a8d-b940-70850db2df51 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:14.782621 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0319265f-f33b-4a8d-b940-70850db2df51 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:14.867512 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-c815cabf-cc0c-4930-b512-79f00aee0263 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:14.873976 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-c815cabf-cc0c-4930-b512-79f00aee0263 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: 268d786c-398a-4305-85ac-545fa3b4370b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:14.901174 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c815cabf-cc0c-4930-b512-79f00aee0263 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:14.902140 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c815cabf-cc0c-4930-b512-79f00aee0263 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:14.902802 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c815cabf-cc0c-4930-b512-79f00aee0263 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:14.903825 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c815cabf-cc0c-4930-b512-79f00aee0263 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:14.904517 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c815cabf-cc0c-4930-b512-79f00aee0263 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:14.905166 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c815cabf-cc0c-4930-b512-79f00aee0263 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:14.972742 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-c815cabf-cc0c-4930-b512-79f00aee0263 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/268d786c-398a-4305-85ac-545fa3b4370b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.115107 Aug 27 02:24:14.979108 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 255/496] 10.222.0.61 () {58 vars in 1302 bytes} [Sat Aug 27 02:24:14 2022] GET /compute/v2.1/servers/268d786c-398a-4305-85ac-545fa3b4370b/os-volume_attachments => generated 197 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:24:15.000009 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-0319265f-f33b-4a8d-b940-70850db2df51 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931dcabba0214e3daa878f31cd1706cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f956d4d27437c830871f6634a3018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:15.016238 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-0319265f-f33b-4a8d-b940-70850db2df51 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] 10.222.0.61 "GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8" status: 200 len: 1358 microversion: 2.1 time: 0.251904 Aug 27 02:24:15.017704 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 242/497] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:14 2022] GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8 => generated 1358 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:24:15.165722 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-0b897f38-13b2-4483-a27b-3b249e5f6b9b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:15.166943 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-0b897f38-13b2-4483-a27b-3b249e5f6b9b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:15.178535 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0b897f38-13b2-4483-a27b-3b249e5f6b9b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:15.179276 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0b897f38-13b2-4483-a27b-3b249e5f6b9b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:15.179889 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0b897f38-13b2-4483-a27b-3b249e5f6b9b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:15.180882 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0b897f38-13b2-4483-a27b-3b249e5f6b9b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:15.181609 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0b897f38-13b2-4483-a27b-3b249e5f6b9b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:15.182695 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0b897f38-13b2-4483-a27b-3b249e5f6b9b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:15.336544 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-5a83c7a1-01c7-4265-bb56-31778b77cb41 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:15.337255 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-5a83c7a1-01c7-4265-bb56-31778b77cb41 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] [instance: 4e641be3-227d-43c1-aa50-ecf2b89529c9] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:15.349284 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5a83c7a1-01c7-4265-bb56-31778b77cb41 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:15.350234 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5a83c7a1-01c7-4265-bb56-31778b77cb41 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:15.351020 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5a83c7a1-01c7-4265-bb56-31778b77cb41 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:15.352810 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5a83c7a1-01c7-4265-bb56-31778b77cb41 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:15.354777 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5a83c7a1-01c7-4265-bb56-31778b77cb41 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:15.355636 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5a83c7a1-01c7-4265-bb56-31778b77cb41 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:15.452885 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-0b897f38-13b2-4483-a27b-3b249e5f6b9b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:15.475241 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-0b897f38-13b2-4483-a27b-3b249e5f6b9b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:15.479902 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-0b897f38-13b2-4483-a27b-3b249e5f6b9b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:15.483145 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-0b897f38-13b2-4483-a27b-3b249e5f6b9b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db" status: 200 len: 1807 microversion: 2.20 time: 0.325361 Aug 27 02:24:15.486921 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-5a83c7a1-01c7-4265-bb56-31778b77cb41 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f931e726872474dae2b7b6fbb0eb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7bf59244bc487b84c7dbf9aa7314d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:15.502569 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 256/498] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:24:15 2022] GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db => generated 1807 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:24:15.510094 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-5a83c7a1-01c7-4265-bb56-31778b77cb41 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] 10.222.0.61 "GET /compute/v2.1/servers/4e641be3-227d-43c1-aa50-ecf2b89529c9" status: 200 len: 1223 microversion: 2.1 time: 0.180237 Aug 27 02:24:15.522431 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 243/499] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:15 2022] GET /compute/v2.1/servers/4e641be3-227d-43c1-aa50-ecf2b89529c9 => generated 1223 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:24:15.629669 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-325dc562-4666-4b22-b3bb-2d085643c359 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:15.630485 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-325dc562-4666-4b22-b3bb-2d085643c359 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] [instance: 9fb59350-4f09-4e20-bddb-ffc9a65897b3] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:15.642168 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-325dc562-4666-4b22-b3bb-2d085643c359 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:15.643068 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-325dc562-4666-4b22-b3bb-2d085643c359 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:15.644193 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-325dc562-4666-4b22-b3bb-2d085643c359 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:15.645769 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-325dc562-4666-4b22-b3bb-2d085643c359 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:15.646991 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-325dc562-4666-4b22-b3bb-2d085643c359 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:15.647728 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-325dc562-4666-4b22-b3bb-2d085643c359 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:15.892711 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-325dc562-4666-4b22-b3bb-2d085643c359 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f53d57f3544e5a25e1beeddab9af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2d4ae1c228446eb5bfc64d44348fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:15.906066 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-325dc562-4666-4b22-b3bb-2d085643c359 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] 10.222.0.61 "GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3" status: 200 len: 1260 microversion: 2.1 time: 0.282511 Aug 27 02:24:15.906788 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 257/500] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:15 2022] GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3 => generated 1260 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:24:15.991453 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-63eea13b-dcf1-4e3e-9e4a-e67efe865169 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:15.996000 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-63eea13b-dcf1-4e3e-9e4a-e67efe865169 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: 268d786c-398a-4305-85ac-545fa3b4370b] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:16.008329 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-63eea13b-dcf1-4e3e-9e4a-e67efe865169 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:16.009377 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-63eea13b-dcf1-4e3e-9e4a-e67efe865169 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:16.010071 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-63eea13b-dcf1-4e3e-9e4a-e67efe865169 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:16.011368 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-63eea13b-dcf1-4e3e-9e4a-e67efe865169 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:16.012204 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-63eea13b-dcf1-4e3e-9e4a-e67efe865169 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:16.013182 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-63eea13b-dcf1-4e3e-9e4a-e67efe865169 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:16.052821 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-1e70a5d0-89b7-456a-9877-c7317716e0a7 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:16.053595 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-1e70a5d0-89b7-456a-9877-c7317716e0a7 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] [instance: 49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:16.060532 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1e70a5d0-89b7-456a-9877-c7317716e0a7 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:16.061033 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1e70a5d0-89b7-456a-9877-c7317716e0a7 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:16.061499 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1e70a5d0-89b7-456a-9877-c7317716e0a7 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:16.062210 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1e70a5d0-89b7-456a-9877-c7317716e0a7 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:16.062661 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1e70a5d0-89b7-456a-9877-c7317716e0a7 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:16.063085 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1e70a5d0-89b7-456a-9877-c7317716e0a7 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:16.075300 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-63eea13b-dcf1-4e3e-9e4a-e67efe865169 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/268d786c-398a-4305-85ac-545fa3b4370b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091975 Aug 27 02:24:16.077590 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 244/501] 10.222.0.61 () {58 vars in 1302 bytes} [Sat Aug 27 02:24:15 2022] GET /compute/v2.1/servers/268d786c-398a-4305-85ac-545fa3b4370b/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:24:16.303214 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-1e70a5d0-89b7-456a-9877-c7317716e0a7 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931dcabba0214e3daa878f31cd1706cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f956d4d27437c830871f6634a3018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:16.312479 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-1e70a5d0-89b7-456a-9877-c7317716e0a7 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] 10.222.0.61 "GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8" status: 200 len: 1358 microversion: 2.1 time: 0.264834 Aug 27 02:24:16.313069 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 258/502] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:16 2022] GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8 => generated 1358 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:24:16.525974 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-067b0406-02cf-479d-8fb8-82299fb77e4c tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:16.527390 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-067b0406-02cf-479d-8fb8-82299fb77e4c tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:16.543896 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-067b0406-02cf-479d-8fb8-82299fb77e4c tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:16.544674 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-067b0406-02cf-479d-8fb8-82299fb77e4c tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:16.545408 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-067b0406-02cf-479d-8fb8-82299fb77e4c tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:16.546578 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-067b0406-02cf-479d-8fb8-82299fb77e4c tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:16.547417 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-067b0406-02cf-479d-8fb8-82299fb77e4c tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:16.548114 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-067b0406-02cf-479d-8fb8-82299fb77e4c tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:16.549276 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-b49985f8-254e-4baf-b801-64fba91bda83 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:16.550438 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-b49985f8-254e-4baf-b801-64fba91bda83 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] [instance: 4e641be3-227d-43c1-aa50-ecf2b89529c9] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:16.564101 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b49985f8-254e-4baf-b801-64fba91bda83 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:16.564990 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b49985f8-254e-4baf-b801-64fba91bda83 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:16.565876 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b49985f8-254e-4baf-b801-64fba91bda83 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:16.567450 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b49985f8-254e-4baf-b801-64fba91bda83 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:16.568271 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b49985f8-254e-4baf-b801-64fba91bda83 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:16.568997 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b49985f8-254e-4baf-b801-64fba91bda83 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:16.722331 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-b49985f8-254e-4baf-b801-64fba91bda83 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f931e726872474dae2b7b6fbb0eb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7bf59244bc487b84c7dbf9aa7314d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:16.739301 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-b49985f8-254e-4baf-b801-64fba91bda83 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] 10.222.0.61 "GET /compute/v2.1/servers/4e641be3-227d-43c1-aa50-ecf2b89529c9" status: 200 len: 1223 microversion: 2.1 time: 0.196890 Aug 27 02:24:16.740870 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 259/503] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:16 2022] GET /compute/v2.1/servers/4e641be3-227d-43c1-aa50-ecf2b89529c9 => generated 1223 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:24:16.907287 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-067b0406-02cf-479d-8fb8-82299fb77e4c tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:16.935319 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-ba25bcc2-3ce0-432e-bb4b-25d92e738b01 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:16.937677 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-067b0406-02cf-479d-8fb8-82299fb77e4c tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:16.940748 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-067b0406-02cf-479d-8fb8-82299fb77e4c tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:16.943029 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-067b0406-02cf-479d-8fb8-82299fb77e4c tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db" status: 200 len: 1807 microversion: 2.20 time: 0.425067 Aug 27 02:24:16.944121 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 245/504] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:24:16 2022] GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db => generated 1807 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:24:16.953897 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-ba25bcc2-3ce0-432e-bb4b-25d92e738b01 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] [instance: 9fb59350-4f09-4e20-bddb-ffc9a65897b3] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:16.972773 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ba25bcc2-3ce0-432e-bb4b-25d92e738b01 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:16.974664 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ba25bcc2-3ce0-432e-bb4b-25d92e738b01 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:16.978505 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ba25bcc2-3ce0-432e-bb4b-25d92e738b01 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:16.979919 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ba25bcc2-3ce0-432e-bb4b-25d92e738b01 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:16.980885 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ba25bcc2-3ce0-432e-bb4b-25d92e738b01 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:16.982041 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ba25bcc2-3ce0-432e-bb4b-25d92e738b01 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:17.091074 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-c0c00d48-ab3a-4e4b-889d-232025eb8c61 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:17.094518 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-c0c00d48-ab3a-4e4b-889d-232025eb8c61 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: 268d786c-398a-4305-85ac-545fa3b4370b] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:17.109747 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c0c00d48-ab3a-4e4b-889d-232025eb8c61 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:17.110670 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c0c00d48-ab3a-4e4b-889d-232025eb8c61 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:17.111119 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c0c00d48-ab3a-4e4b-889d-232025eb8c61 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:17.111933 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c0c00d48-ab3a-4e4b-889d-232025eb8c61 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:17.112383 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c0c00d48-ab3a-4e4b-889d-232025eb8c61 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:17.112985 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c0c00d48-ab3a-4e4b-889d-232025eb8c61 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:17.185515 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-c0c00d48-ab3a-4e4b-889d-232025eb8c61 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/268d786c-398a-4305-85ac-545fa3b4370b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098768 Aug 27 02:24:17.194464 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 246/505] 10.222.0.61 () {58 vars in 1302 bytes} [Sat Aug 27 02:24:17 2022] GET /compute/v2.1/servers/268d786c-398a-4305-85ac-545fa3b4370b/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:24:17.278426 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-ba25bcc2-3ce0-432e-bb4b-25d92e738b01 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f53d57f3544e5a25e1beeddab9af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2d4ae1c228446eb5bfc64d44348fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:17.288398 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-ba25bcc2-3ce0-432e-bb4b-25d92e738b01 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] 10.222.0.61 "GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3" status: 200 len: 1260 microversion: 2.1 time: 0.360790 Aug 27 02:24:17.289144 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 260/506] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:16 2022] GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3 => generated 1260 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:24:17.347559 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-a0636031-9eb8-4d7c-bbf5-1fa739e97ed7 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:17.347955 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-a0636031-9eb8-4d7c-bbf5-1fa739e97ed7 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] [instance: 49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:17.360262 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a0636031-9eb8-4d7c-bbf5-1fa739e97ed7 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:17.361567 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a0636031-9eb8-4d7c-bbf5-1fa739e97ed7 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:17.362577 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a0636031-9eb8-4d7c-bbf5-1fa739e97ed7 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:17.364145 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a0636031-9eb8-4d7c-bbf5-1fa739e97ed7 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:17.365204 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a0636031-9eb8-4d7c-bbf5-1fa739e97ed7 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:17.366204 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a0636031-9eb8-4d7c-bbf5-1fa739e97ed7 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:17.608965 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-a0636031-9eb8-4d7c-bbf5-1fa739e97ed7 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931dcabba0214e3daa878f31cd1706cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f956d4d27437c830871f6634a3018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:17.624240 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-a0636031-9eb8-4d7c-bbf5-1fa739e97ed7 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] 10.222.0.61 "GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8" status: 200 len: 1358 microversion: 2.1 time: 0.284863 Aug 27 02:24:17.635872 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 247/507] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:17 2022] GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8 => generated 1358 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:24:17.774313 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-810531dd-d9af-47a9-b630-56f4fa6ccdc4 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:17.774979 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-810531dd-d9af-47a9-b630-56f4fa6ccdc4 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] [instance: 4e641be3-227d-43c1-aa50-ecf2b89529c9] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:17.781967 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-810531dd-d9af-47a9-b630-56f4fa6ccdc4 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:17.782456 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-810531dd-d9af-47a9-b630-56f4fa6ccdc4 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:17.782888 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-810531dd-d9af-47a9-b630-56f4fa6ccdc4 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:17.783926 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-810531dd-d9af-47a9-b630-56f4fa6ccdc4 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:17.784456 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-810531dd-d9af-47a9-b630-56f4fa6ccdc4 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:17.784886 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-810531dd-d9af-47a9-b630-56f4fa6ccdc4 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:17.857328 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-810531dd-d9af-47a9-b630-56f4fa6ccdc4 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f931e726872474dae2b7b6fbb0eb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7bf59244bc487b84c7dbf9aa7314d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:17.866087 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-810531dd-d9af-47a9-b630-56f4fa6ccdc4 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] 10.222.0.61 "GET /compute/v2.1/servers/4e641be3-227d-43c1-aa50-ecf2b89529c9" status: 200 len: 1223 microversion: 2.1 time: 0.096284 Aug 27 02:24:17.866393 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 261/508] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:17 2022] GET /compute/v2.1/servers/4e641be3-227d-43c1-aa50-ecf2b89529c9 => generated 1223 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:24:17.992891 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-777b1624-eb79-4d1b-88fa-c83e655894e2 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:17.994913 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-777b1624-eb79-4d1b-88fa-c83e655894e2 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:18.005971 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-777b1624-eb79-4d1b-88fa-c83e655894e2 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:18.006811 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-777b1624-eb79-4d1b-88fa-c83e655894e2 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:18.007334 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-777b1624-eb79-4d1b-88fa-c83e655894e2 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:18.008734 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-777b1624-eb79-4d1b-88fa-c83e655894e2 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:18.009740 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-777b1624-eb79-4d1b-88fa-c83e655894e2 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:18.010598 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-777b1624-eb79-4d1b-88fa-c83e655894e2 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:18.188244 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-777b1624-eb79-4d1b-88fa-c83e655894e2 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:18.198365 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-777b1624-eb79-4d1b-88fa-c83e655894e2 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:18.200107 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-777b1624-eb79-4d1b-88fa-c83e655894e2 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:18.201431 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-777b1624-eb79-4d1b-88fa-c83e655894e2 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db" status: 200 len: 1807 microversion: 2.20 time: 0.215956 Aug 27 02:24:18.201767 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-d8dc294a-aa02-49e4-8ddf-798cc9a0c564 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:18.202532 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 248/509] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:24:17 2022] GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db => generated 1807 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:24:18.204318 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-d8dc294a-aa02-49e4-8ddf-798cc9a0c564 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: 268d786c-398a-4305-85ac-545fa3b4370b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:18.211039 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d8dc294a-aa02-49e4-8ddf-798cc9a0c564 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:18.211551 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d8dc294a-aa02-49e4-8ddf-798cc9a0c564 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:18.211979 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d8dc294a-aa02-49e4-8ddf-798cc9a0c564 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:18.212667 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d8dc294a-aa02-49e4-8ddf-798cc9a0c564 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:18.213266 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d8dc294a-aa02-49e4-8ddf-798cc9a0c564 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:18.213723 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d8dc294a-aa02-49e4-8ddf-798cc9a0c564 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:18.236198 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:24:18.252555 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-d8dc294a-aa02-49e4-8ddf-798cc9a0c564 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/268d786c-398a-4305-85ac-545fa3b4370b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055320 Aug 27 02:24:18.253138 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 262/510] 10.222.0.61 () {58 vars in 1302 bytes} [Sat Aug 27 02:24:18 2022] GET /compute/v2.1/servers/268d786c-398a-4305-85ac-545fa3b4370b/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:24:18.322042 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-f86687b5-1d90-4ee8-956d-a7c290f8e8ae tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:18.322770 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-f86687b5-1d90-4ee8-956d-a7c290f8e8ae tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] [instance: 9fb59350-4f09-4e20-bddb-ffc9a65897b3] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:18.329971 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f86687b5-1d90-4ee8-956d-a7c290f8e8ae tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:18.330731 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f86687b5-1d90-4ee8-956d-a7c290f8e8ae tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:18.331266 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f86687b5-1d90-4ee8-956d-a7c290f8e8ae tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:18.332080 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f86687b5-1d90-4ee8-956d-a7c290f8e8ae tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:18.332633 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f86687b5-1d90-4ee8-956d-a7c290f8e8ae tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:18.333144 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f86687b5-1d90-4ee8-956d-a7c290f8e8ae tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:18.476699 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-f86687b5-1d90-4ee8-956d-a7c290f8e8ae tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f53d57f3544e5a25e1beeddab9af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2d4ae1c228446eb5bfc64d44348fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:18.487556 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-f86687b5-1d90-4ee8-956d-a7c290f8e8ae tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] 10.222.0.61 "GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3" status: 200 len: 1260 microversion: 2.1 time: 0.169610 Aug 27 02:24:18.488517 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 249/511] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:18 2022] GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3 => generated 1260 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:24:18.493611 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-63a3ccaa-f21a-41ea-9233-02ba2d535f18 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "614bb599-3532-4c25-b75a-988e7b9264ac"}} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:24:18.497888 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-63a3ccaa-f21a-41ea-9233-02ba2d535f18 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 1b9390be-aab0-4240-83d9-0f815f094605] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:18.509208 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-63a3ccaa-f21a-41ea-9233-02ba2d535f18 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:18.510092 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-63a3ccaa-f21a-41ea-9233-02ba2d535f18 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:18.510867 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-63a3ccaa-f21a-41ea-9233-02ba2d535f18 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:18.512102 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-63a3ccaa-f21a-41ea-9233-02ba2d535f18 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:18.512904 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-63a3ccaa-f21a-41ea-9233-02ba2d535f18 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:18.513683 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-63a3ccaa-f21a-41ea-9233-02ba2d535f18 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:18.661283 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-d978b5a3-d2e5-4722-864c-8aca0f55bfaf tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:18.662666 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-d978b5a3-d2e5-4722-864c-8aca0f55bfaf tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] [instance: 49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:18.674713 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d978b5a3-d2e5-4722-864c-8aca0f55bfaf tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:18.675381 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d978b5a3-d2e5-4722-864c-8aca0f55bfaf tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:18.676009 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d978b5a3-d2e5-4722-864c-8aca0f55bfaf tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:18.676775 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d978b5a3-d2e5-4722-864c-8aca0f55bfaf tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:18.677343 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d978b5a3-d2e5-4722-864c-8aca0f55bfaf tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:18.677851 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d978b5a3-d2e5-4722-864c-8aca0f55bfaf tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:18.836139 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-d978b5a3-d2e5-4722-864c-8aca0f55bfaf tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931dcabba0214e3daa878f31cd1706cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f956d4d27437c830871f6634a3018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:18.845119 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-d978b5a3-d2e5-4722-864c-8aca0f55bfaf tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] 10.222.0.61 "GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8" status: 200 len: 1358 microversion: 2.1 time: 0.189236 Aug 27 02:24:18.845915 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 250/512] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:18 2022] GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8 => generated 1358 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:24:18.889074 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-329096c5-a067-40aa-a583-0bcae5627d1e tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:18.889957 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-329096c5-a067-40aa-a583-0bcae5627d1e tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] [instance: 4e641be3-227d-43c1-aa50-ecf2b89529c9] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:18.897252 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-329096c5-a067-40aa-a583-0bcae5627d1e tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:18.897786 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-329096c5-a067-40aa-a583-0bcae5627d1e tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:18.898214 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-329096c5-a067-40aa-a583-0bcae5627d1e tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:18.898922 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-329096c5-a067-40aa-a583-0bcae5627d1e tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:18.899418 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-329096c5-a067-40aa-a583-0bcae5627d1e tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:18.899834 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-329096c5-a067-40aa-a583-0bcae5627d1e tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:18.967188 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-329096c5-a067-40aa-a583-0bcae5627d1e tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f931e726872474dae2b7b6fbb0eb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7bf59244bc487b84c7dbf9aa7314d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:18.975457 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-329096c5-a067-40aa-a583-0bcae5627d1e tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] 10.222.0.61 "GET /compute/v2.1/servers/4e641be3-227d-43c1-aa50-ecf2b89529c9" status: 200 len: 1223 microversion: 2.1 time: 0.091051 Aug 27 02:24:18.976048 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 251/513] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:18 2022] GET /compute/v2.1/servers/4e641be3-227d-43c1-aa50-ecf2b89529c9 => generated 1223 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:24:19.243855 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-02251a66-3a96-4764-b069-58ec69463e4d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:19.244438 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-02251a66-3a96-4764-b069-58ec69463e4d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:19.251376 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-02251a66-3a96-4764-b069-58ec69463e4d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:19.251959 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-02251a66-3a96-4764-b069-58ec69463e4d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:19.252399 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-02251a66-3a96-4764-b069-58ec69463e4d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:19.253375 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-02251a66-3a96-4764-b069-58ec69463e4d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:19.253852 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-02251a66-3a96-4764-b069-58ec69463e4d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:19.254273 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-02251a66-3a96-4764-b069-58ec69463e4d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:19.398033 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-02251a66-3a96-4764-b069-58ec69463e4d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:19.407890 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-02251a66-3a96-4764-b069-58ec69463e4d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:19.409554 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-02251a66-3a96-4764-b069-58ec69463e4d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:19.410736 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-02251a66-3a96-4764-b069-58ec69463e4d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db" status: 200 len: 1807 microversion: 2.20 time: 0.170951 Aug 27 02:24:19.411302 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 252/514] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:24:19 2022] GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db => generated 1807 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:24:19.416103 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-ce4a2fb9-767c-4b69-9d33-af07e29673a9 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:19.418350 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-ce4a2fb9-767c-4b69-9d33-af07e29673a9 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: 268d786c-398a-4305-85ac-545fa3b4370b] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:19.424468 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ce4a2fb9-767c-4b69-9d33-af07e29673a9 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:19.424955 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ce4a2fb9-767c-4b69-9d33-af07e29673a9 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:19.425377 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ce4a2fb9-767c-4b69-9d33-af07e29673a9 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:19.426127 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ce4a2fb9-767c-4b69-9d33-af07e29673a9 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:19.426576 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ce4a2fb9-767c-4b69-9d33-af07e29673a9 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:19.426996 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ce4a2fb9-767c-4b69-9d33-af07e29673a9 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:19.471523 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-ce4a2fb9-767c-4b69-9d33-af07e29673a9 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/268d786c-398a-4305-85ac-545fa3b4370b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058912 Aug 27 02:24:19.472410 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 253/515] 10.222.0.61 () {58 vars in 1302 bytes} [Sat Aug 27 02:24:19 2022] GET /compute/v2.1/servers/268d786c-398a-4305-85ac-545fa3b4370b/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:24:19.510618 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-54a76c3b-5843-4f46-b08c-798938266b18 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:19.511134 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-54a76c3b-5843-4f46-b08c-798938266b18 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] [instance: 9fb59350-4f09-4e20-bddb-ffc9a65897b3] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:19.518038 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-54a76c3b-5843-4f46-b08c-798938266b18 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:19.518884 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-54a76c3b-5843-4f46-b08c-798938266b18 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:19.519168 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-54a76c3b-5843-4f46-b08c-798938266b18 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:19.519974 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-54a76c3b-5843-4f46-b08c-798938266b18 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:19.520419 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-54a76c3b-5843-4f46-b08c-798938266b18 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:19.520989 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-54a76c3b-5843-4f46-b08c-798938266b18 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:19.526323 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:24:19.661613 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-54a76c3b-5843-4f46-b08c-798938266b18 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f53d57f3544e5a25e1beeddab9af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2d4ae1c228446eb5bfc64d44348fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:19.670249 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-54a76c3b-5843-4f46-b08c-798938266b18 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] 10.222.0.61 "GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3" status: 200 len: 1260 microversion: 2.1 time: 0.163709 Aug 27 02:24:19.670842 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 254/516] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:19 2022] GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3 => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:24:19.875318 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-0cbc26e3-92e9-4b6f-966b-3df0c6e43540 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:19.876058 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-0cbc26e3-92e9-4b6f-966b-3df0c6e43540 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] [instance: 49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:19.890046 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0cbc26e3-92e9-4b6f-966b-3df0c6e43540 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:19.890581 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0cbc26e3-92e9-4b6f-966b-3df0c6e43540 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:19.892449 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0cbc26e3-92e9-4b6f-966b-3df0c6e43540 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:19.893428 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0cbc26e3-92e9-4b6f-966b-3df0c6e43540 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:19.893912 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0cbc26e3-92e9-4b6f-966b-3df0c6e43540 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:19.894526 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0cbc26e3-92e9-4b6f-966b-3df0c6e43540 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:20.065895 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-0cbc26e3-92e9-4b6f-966b-3df0c6e43540 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931dcabba0214e3daa878f31cd1706cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f956d4d27437c830871f6634a3018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:20.083141 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-0cbc26e3-92e9-4b6f-966b-3df0c6e43540 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] 10.222.0.61 "GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8" status: 200 len: 1358 microversion: 2.1 time: 0.211537 Aug 27 02:24:20.084209 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 255/517] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:19 2022] GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8 => generated 1358 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:24:20.096197 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-fbd12cba-ad42-4ac9-b524-0debf8256f44 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:20.096833 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-fbd12cba-ad42-4ac9-b524-0debf8256f44 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] [instance: 4e641be3-227d-43c1-aa50-ecf2b89529c9] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:20.105161 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fbd12cba-ad42-4ac9-b524-0debf8256f44 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:20.105709 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fbd12cba-ad42-4ac9-b524-0debf8256f44 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:20.106166 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fbd12cba-ad42-4ac9-b524-0debf8256f44 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:20.107082 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fbd12cba-ad42-4ac9-b524-0debf8256f44 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:20.107586 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fbd12cba-ad42-4ac9-b524-0debf8256f44 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:20.108359 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fbd12cba-ad42-4ac9-b524-0debf8256f44 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:20.175449 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-fbd12cba-ad42-4ac9-b524-0debf8256f44 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f931e726872474dae2b7b6fbb0eb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7bf59244bc487b84c7dbf9aa7314d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:20.184113 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-fbd12cba-ad42-4ac9-b524-0debf8256f44 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] 10.222.0.61 "GET /compute/v2.1/servers/4e641be3-227d-43c1-aa50-ecf2b89529c9" status: 200 len: 1215 microversion: 2.1 time: 0.093738 Aug 27 02:24:20.184764 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 256/518] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:20 2022] GET /compute/v2.1/servers/4e641be3-227d-43c1-aa50-ecf2b89529c9 => generated 1215 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:24:20.376852 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-9235aa4e-45c4-4f2a-8085-7fc83278b072 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:24:20.383944 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9235aa4e-45c4-4f2a-8085-7fc83278b072 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:20.384436 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9235aa4e-45c4-4f2a-8085-7fc83278b072 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:20.384874 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9235aa4e-45c4-4f2a-8085-7fc83278b072 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:20.409680 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-9235aa4e-45c4-4f2a-8085-7fc83278b072 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 4fedf0d1-cc1c-4947-b92e-dcb4454889d1] Going to try to stop instance {{(pid=120783) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 27 02:24:20.461838 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-9235aa4e-45c4-4f2a-8085-7fc83278b072 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "POST /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1/action" status: 202 len: 0 microversion: 2.1 time: 0.088426 Aug 27 02:24:20.462894 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 257/519] 10.222.0.61 () {60 vars in 1278 bytes} [Sat Aug 27 02:24:20 2022] POST /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 02:24:20.468699 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-658c1ef2-8494-4eb8-8607-90537acd4ea7 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:20.469418 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-658c1ef2-8494-4eb8-8607-90537acd4ea7 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:20.476310 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-658c1ef2-8494-4eb8-8607-90537acd4ea7 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:20.476839 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-658c1ef2-8494-4eb8-8607-90537acd4ea7 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:20.477318 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-658c1ef2-8494-4eb8-8607-90537acd4ea7 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:20.478070 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-658c1ef2-8494-4eb8-8607-90537acd4ea7 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:20.478544 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-658c1ef2-8494-4eb8-8607-90537acd4ea7 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:20.478943 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-658c1ef2-8494-4eb8-8607-90537acd4ea7 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:20.624525 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-658c1ef2-8494-4eb8-8607-90537acd4ea7 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:20.633827 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-658c1ef2-8494-4eb8-8607-90537acd4ea7 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:20.635286 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-658c1ef2-8494-4eb8-8607-90537acd4ea7 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:20.636482 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-658c1ef2-8494-4eb8-8607-90537acd4ea7 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db" status: 200 len: 1807 microversion: 2.20 time: 0.172570 Aug 27 02:24:20.652197 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 258/520] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:24:20 2022] GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db => generated 1807 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:24:20.652197 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-50fcb27a-67f0-4e47-8480-0b16002f1ab3 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:20.652197 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-50fcb27a-67f0-4e47-8480-0b16002f1ab3 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 4fedf0d1-cc1c-4947-b92e-dcb4454889d1] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:20.652197 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-50fcb27a-67f0-4e47-8480-0b16002f1ab3 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:20.652197 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-50fcb27a-67f0-4e47-8480-0b16002f1ab3 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:20.652745 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-50fcb27a-67f0-4e47-8480-0b16002f1ab3 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:20.652745 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-50fcb27a-67f0-4e47-8480-0b16002f1ab3 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:20.652745 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-50fcb27a-67f0-4e47-8480-0b16002f1ab3 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:20.652745 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-50fcb27a-67f0-4e47-8480-0b16002f1ab3 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:20.790257 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-50fcb27a-67f0-4e47-8480-0b16002f1ab3 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fbea2c71674b239e6d8fba6518e962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d9d02db5c49fda33321f2914a7f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:20.802447 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-50fcb27a-67f0-4e47-8480-0b16002f1ab3 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1" status: 200 len: 1720 microversion: 2.1 time: 0.164215 Aug 27 02:24:20.803308 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 259/521] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:20 2022] GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1 => generated 1720 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:24:20.808665 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-2f8b90a7-5344-4bee-b783-5cd4c7ca6dfb tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:20.810921 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-2f8b90a7-5344-4bee-b783-5cd4c7ca6dfb tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: 268d786c-398a-4305-85ac-545fa3b4370b] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:20.817047 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2f8b90a7-5344-4bee-b783-5cd4c7ca6dfb tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:20.817562 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2f8b90a7-5344-4bee-b783-5cd4c7ca6dfb tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:20.817994 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2f8b90a7-5344-4bee-b783-5cd4c7ca6dfb tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:20.818679 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2f8b90a7-5344-4bee-b783-5cd4c7ca6dfb tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:20.819127 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2f8b90a7-5344-4bee-b783-5cd4c7ca6dfb tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:20.819542 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2f8b90a7-5344-4bee-b783-5cd4c7ca6dfb tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:20.849812 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-2f8b90a7-5344-4bee-b783-5cd4c7ca6dfb tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/268d786c-398a-4305-85ac-545fa3b4370b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045086 Aug 27 02:24:20.850282 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 260/522] 10.222.0.61 () {58 vars in 1302 bytes} [Sat Aug 27 02:24:20 2022] GET /compute/v2.1/servers/268d786c-398a-4305-85ac-545fa3b4370b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:24:20.854880 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-c57383d5-d0b1-457c-8e9c-daef0fbb29e4 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:20.855469 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-c57383d5-d0b1-457c-8e9c-daef0fbb29e4 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] [instance: 9fb59350-4f09-4e20-bddb-ffc9a65897b3] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:20.861519 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c57383d5-d0b1-457c-8e9c-daef0fbb29e4 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:20.861979 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c57383d5-d0b1-457c-8e9c-daef0fbb29e4 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:20.862403 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c57383d5-d0b1-457c-8e9c-daef0fbb29e4 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:20.863080 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c57383d5-d0b1-457c-8e9c-daef0fbb29e4 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:20.863520 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c57383d5-d0b1-457c-8e9c-daef0fbb29e4 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:20.864283 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c57383d5-d0b1-457c-8e9c-daef0fbb29e4 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:21.014059 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-c57383d5-d0b1-457c-8e9c-daef0fbb29e4 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f53d57f3544e5a25e1beeddab9af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2d4ae1c228446eb5bfc64d44348fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:21.022221 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-c57383d5-d0b1-457c-8e9c-daef0fbb29e4 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] 10.222.0.61 "GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3" status: 200 len: 1260 microversion: 2.1 time: 0.170973 Aug 27 02:24:21.022788 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 261/523] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:20 2022] GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3 => generated 1260 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:24:21.116040 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-93f46ea4-97dd-4120-86e9-e3b3c6d5cb0e tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:21.116560 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-93f46ea4-97dd-4120-86e9-e3b3c6d5cb0e tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] [instance: 49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:21.123013 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-93f46ea4-97dd-4120-86e9-e3b3c6d5cb0e tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:21.123513 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-93f46ea4-97dd-4120-86e9-e3b3c6d5cb0e tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:21.123965 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-93f46ea4-97dd-4120-86e9-e3b3c6d5cb0e tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:21.124696 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-93f46ea4-97dd-4120-86e9-e3b3c6d5cb0e tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:21.125151 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-93f46ea4-97dd-4120-86e9-e3b3c6d5cb0e tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:21.125630 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-93f46ea4-97dd-4120-86e9-e3b3c6d5cb0e tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:21.231865 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell0:SELECT=2 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:24:21.273434 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-93f46ea4-97dd-4120-86e9-e3b3c6d5cb0e tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931dcabba0214e3daa878f31cd1706cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f956d4d27437c830871f6634a3018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:21.283699 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-93f46ea4-97dd-4120-86e9-e3b3c6d5cb0e tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] 10.222.0.61 "GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8" status: 200 len: 1358 microversion: 2.1 time: 0.171453 Aug 27 02:24:21.284497 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 262/524] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:21 2022] GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:24:21.289381 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-de96897f-7f28-45de-87c8-5de13a73d97f tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:21.290092 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-de96897f-7f28-45de-87c8-5de13a73d97f tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] [instance: 4e641be3-227d-43c1-aa50-ecf2b89529c9] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:21.296651 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-de96897f-7f28-45de-87c8-5de13a73d97f tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:21.297151 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-de96897f-7f28-45de-87c8-5de13a73d97f tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:21.297655 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-de96897f-7f28-45de-87c8-5de13a73d97f tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:21.298362 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-de96897f-7f28-45de-87c8-5de13a73d97f tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:21.298815 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-de96897f-7f28-45de-87c8-5de13a73d97f tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:21.299253 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-de96897f-7f28-45de-87c8-5de13a73d97f tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:21.341508 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell0:SELECT=6 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:24:21.640417 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-63a3ccaa-f21a-41ea-9233-02ba2d535f18 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "POST /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.154817 Aug 27 02:24:21.643149 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 263/525] 10.222.0.61 () {60 vars in 1323 bytes} [Sat Aug 27 02:24:18 2022] POST /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605/os-volume_attachments => generated 194 bytes in 3159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:24:21.661099 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-de96897f-7f28-45de-87c8-5de13a73d97f tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f931e726872474dae2b7b6fbb0eb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7bf59244bc487b84c7dbf9aa7314d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:21.661753 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-8869e7a5-fae2-4d9a-a7a3-593633c25ec4 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:21.662388 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-8869e7a5-fae2-4d9a-a7a3-593633c25ec4 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:21.669173 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8869e7a5-fae2-4d9a-a7a3-593633c25ec4 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:21.669698 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8869e7a5-fae2-4d9a-a7a3-593633c25ec4 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:21.670134 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8869e7a5-fae2-4d9a-a7a3-593633c25ec4 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:21.670919 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8869e7a5-fae2-4d9a-a7a3-593633c25ec4 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:21.671624 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8869e7a5-fae2-4d9a-a7a3-593633c25ec4 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:21.672273 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8869e7a5-fae2-4d9a-a7a3-593633c25ec4 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:21.685886 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-de96897f-7f28-45de-87c8-5de13a73d97f tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] 10.222.0.61 "GET /compute/v2.1/servers/4e641be3-227d-43c1-aa50-ecf2b89529c9" status: 200 len: 1215 microversion: 2.1 time: 0.400033 Aug 27 02:24:21.686627 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 263/526] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:21 2022] GET /compute/v2.1/servers/4e641be3-227d-43c1-aa50-ecf2b89529c9 => generated 1215 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:24:21.830030 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-cd84fb48-e285-4e72-8f42-e08afcbf244b tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:21.831827 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-cd84fb48-e285-4e72-8f42-e08afcbf244b tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 4fedf0d1-cc1c-4947-b92e-dcb4454889d1] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:21.843127 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-cd84fb48-e285-4e72-8f42-e08afcbf244b tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:21.844585 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-cd84fb48-e285-4e72-8f42-e08afcbf244b tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:21.845729 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-cd84fb48-e285-4e72-8f42-e08afcbf244b tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:21.847562 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-cd84fb48-e285-4e72-8f42-e08afcbf244b tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:21.848879 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-cd84fb48-e285-4e72-8f42-e08afcbf244b tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:21.850086 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-cd84fb48-e285-4e72-8f42-e08afcbf244b tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:21.865687 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-8869e7a5-fae2-4d9a-a7a3-593633c25ec4 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:21.879185 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-8869e7a5-fae2-4d9a-a7a3-593633c25ec4 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:21.881965 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-8869e7a5-fae2-4d9a-a7a3-593633c25ec4 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:21.883796 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-8869e7a5-fae2-4d9a-a7a3-593633c25ec4 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db" status: 200 len: 1807 microversion: 2.20 time: 0.227182 Aug 27 02:24:21.901562 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 264/527] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:24:21 2022] GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db => generated 1807 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:24:21.901562 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-0dc2d2b9-ec61-47ac-b424-c63ad4432335 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:21.901562 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-0dc2d2b9-ec61-47ac-b424-c63ad4432335 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: 268d786c-398a-4305-85ac-545fa3b4370b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:21.909553 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0dc2d2b9-ec61-47ac-b424-c63ad4432335 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:21.910046 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0dc2d2b9-ec61-47ac-b424-c63ad4432335 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:21.910485 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0dc2d2b9-ec61-47ac-b424-c63ad4432335 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:21.911210 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0dc2d2b9-ec61-47ac-b424-c63ad4432335 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:21.911670 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0dc2d2b9-ec61-47ac-b424-c63ad4432335 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:21.912101 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0dc2d2b9-ec61-47ac-b424-c63ad4432335 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:21.951388 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-0dc2d2b9-ec61-47ac-b424-c63ad4432335 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/268d786c-398a-4305-85ac-545fa3b4370b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065383 Aug 27 02:24:21.951990 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 265/528] 10.222.0.61 () {58 vars in 1302 bytes} [Sat Aug 27 02:24:21 2022] GET /compute/v2.1/servers/268d786c-398a-4305-85ac-545fa3b4370b/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:24:22.018653 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-cd84fb48-e285-4e72-8f42-e08afcbf244b tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fbea2c71674b239e6d8fba6518e962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d9d02db5c49fda33321f2914a7f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:22.027686 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-cd84fb48-e285-4e72-8f42-e08afcbf244b tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1" status: 200 len: 1674 microversion: 2.1 time: 0.205384 Aug 27 02:24:22.028447 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 264/529] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:21 2022] GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1 => generated 1674 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:24:22.051570 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-1cf00486-aa02-473d-b104-0c1ee83a325d tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:22.052250 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-1cf00486-aa02-473d-b104-0c1ee83a325d tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] [instance: 9fb59350-4f09-4e20-bddb-ffc9a65897b3] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:22.058190 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell0:SELECT=2 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:24:22.061104 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1cf00486-aa02-473d-b104-0c1ee83a325d tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:22.061104 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1cf00486-aa02-473d-b104-0c1ee83a325d tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:22.061667 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1cf00486-aa02-473d-b104-0c1ee83a325d tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:22.062261 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1cf00486-aa02-473d-b104-0c1ee83a325d tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:22.062734 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1cf00486-aa02-473d-b104-0c1ee83a325d tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:22.063161 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1cf00486-aa02-473d-b104-0c1ee83a325d tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:22.219673 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [req-82482943-1ad9-4170-bfe6-0b2c5fad89c4 req-e8440bbc-2d58-4046-b0e3-b2411fe1c575 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fb59350-4f09-4e20-bddb-ffc9a65897b3", "name": "network-vif-plugged", "status": "completed", "tag": "b6386749-9042-42f7-933e-fe24b60012ef"}]} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:24:22.245621 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-82482943-1ad9-4170-bfe6-0b2c5fad89c4 req-e8440bbc-2d58-4046-b0e3-b2411fe1c575 service nova] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:22.247000 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-82482943-1ad9-4170-bfe6-0b2c5fad89c4 req-e8440bbc-2d58-4046-b0e3-b2411fe1c575 service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:22.247866 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-82482943-1ad9-4170-bfe6-0b2c5fad89c4 req-e8440bbc-2d58-4046-b0e3-b2411fe1c575 service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:22.269857 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.compute.server_external_events [req-82482943-1ad9-4170-bfe6-0b2c5fad89c4 req-e8440bbc-2d58-4046-b0e3-b2411fe1c575 service nova] Creating event network-vif-plugged:b6386749-9042-42f7-933e-fe24b60012ef for instance 9fb59350-4f09-4e20-bddb-ffc9a65897b3 on hv-cinder-84630 Aug 27 02:24:22.281125 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [req-82482943-1ad9-4170-bfe6-0b2c5fad89c4 req-e8440bbc-2d58-4046-b0e3-b2411fe1c575 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065330 Aug 27 02:24:22.282781 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 265/530] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Aug 27 02:24:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:24:22.285628 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-1cf00486-aa02-473d-b104-0c1ee83a325d tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f53d57f3544e5a25e1beeddab9af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2d4ae1c228446eb5bfc64d44348fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:22.294663 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-1cf00486-aa02-473d-b104-0c1ee83a325d tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] 10.222.0.61 "GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3" status: 200 len: 1260 microversion: 2.1 time: 0.249157 Aug 27 02:24:22.295246 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 266/531] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:22 2022] GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3 => generated 1260 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:24:22.306089 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-dd4ce6ea-6350-42c3-80a5-0656a9ea1e3b tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:22.307563 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-dd4ce6ea-6350-42c3-80a5-0656a9ea1e3b tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] [instance: 49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:22.319906 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-dd4ce6ea-6350-42c3-80a5-0656a9ea1e3b tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:22.320402 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-dd4ce6ea-6350-42c3-80a5-0656a9ea1e3b tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:22.321054 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-dd4ce6ea-6350-42c3-80a5-0656a9ea1e3b tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:22.321875 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-dd4ce6ea-6350-42c3-80a5-0656a9ea1e3b tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:22.322337 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-dd4ce6ea-6350-42c3-80a5-0656a9ea1e3b tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:22.322759 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-dd4ce6ea-6350-42c3-80a5-0656a9ea1e3b tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:22.478492 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-dd4ce6ea-6350-42c3-80a5-0656a9ea1e3b tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931dcabba0214e3daa878f31cd1706cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f956d4d27437c830871f6634a3018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:22.488839 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-dd4ce6ea-6350-42c3-80a5-0656a9ea1e3b tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] 10.222.0.61 "GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8" status: 200 len: 1358 microversion: 2.1 time: 0.187870 Aug 27 02:24:22.489488 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 266/532] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:22 2022] GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8 => generated 1358 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:24:22.726330 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-003dd1de-5347-4167-9701-450f44d116b1 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:22.728660 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-003dd1de-5347-4167-9701-450f44d116b1 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] [instance: 4e641be3-227d-43c1-aa50-ecf2b89529c9] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:22.740877 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-003dd1de-5347-4167-9701-450f44d116b1 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:22.742042 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-003dd1de-5347-4167-9701-450f44d116b1 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:22.743485 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-003dd1de-5347-4167-9701-450f44d116b1 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:22.745733 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-003dd1de-5347-4167-9701-450f44d116b1 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:22.746684 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-003dd1de-5347-4167-9701-450f44d116b1 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:22.747763 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-003dd1de-5347-4167-9701-450f44d116b1 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:22.842155 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-003dd1de-5347-4167-9701-450f44d116b1 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f931e726872474dae2b7b6fbb0eb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7bf59244bc487b84c7dbf9aa7314d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:22.851465 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-003dd1de-5347-4167-9701-450f44d116b1 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] 10.222.0.61 "GET /compute/v2.1/servers/4e641be3-227d-43c1-aa50-ecf2b89529c9" status: 200 len: 1271 microversion: 2.1 time: 0.132050 Aug 27 02:24:22.852149 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 267/533] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:22 2022] GET /compute/v2.1/servers/4e641be3-227d-43c1-aa50-ecf2b89529c9 => generated 1271 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:24:22.930341 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-99da9452-9c95-48f9-8112-a0e96c0f9de9 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:22.931098 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-99da9452-9c95-48f9-8112-a0e96c0f9de9 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:22.937480 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-99da9452-9c95-48f9-8112-a0e96c0f9de9 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:22.937979 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-99da9452-9c95-48f9-8112-a0e96c0f9de9 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:22.938469 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-99da9452-9c95-48f9-8112-a0e96c0f9de9 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:22.939110 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-99da9452-9c95-48f9-8112-a0e96c0f9de9 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:22.939560 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-99da9452-9c95-48f9-8112-a0e96c0f9de9 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:22.939982 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-99da9452-9c95-48f9-8112-a0e96c0f9de9 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:22.966981 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-6a916901-ed93-4d91-aced-54888fa5a735 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:22.969724 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-6a916901-ed93-4d91-aced-54888fa5a735 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: 268d786c-398a-4305-85ac-545fa3b4370b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:22.977351 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6a916901-ed93-4d91-aced-54888fa5a735 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:22.978030 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6a916901-ed93-4d91-aced-54888fa5a735 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:22.978463 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6a916901-ed93-4d91-aced-54888fa5a735 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:22.979201 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6a916901-ed93-4d91-aced-54888fa5a735 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:22.979738 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6a916901-ed93-4d91-aced-54888fa5a735 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:22.980159 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6a916901-ed93-4d91-aced-54888fa5a735 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:23.015469 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-6a916901-ed93-4d91-aced-54888fa5a735 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/268d786c-398a-4305-85ac-545fa3b4370b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052864 Aug 27 02:24:23.016652 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 268/534] 10.222.0.61 () {58 vars in 1302 bytes} [Sat Aug 27 02:24:22 2022] GET /compute/v2.1/servers/268d786c-398a-4305-85ac-545fa3b4370b/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:24:23.059524 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-e305aa52-4d2b-464b-a2d6-a8972d48d571 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:23.060381 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-e305aa52-4d2b-464b-a2d6-a8972d48d571 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 4fedf0d1-cc1c-4947-b92e-dcb4454889d1] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:23.066980 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e305aa52-4d2b-464b-a2d6-a8972d48d571 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:23.067611 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e305aa52-4d2b-464b-a2d6-a8972d48d571 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:23.068039 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e305aa52-4d2b-464b-a2d6-a8972d48d571 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:23.068736 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e305aa52-4d2b-464b-a2d6-a8972d48d571 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:23.069168 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e305aa52-4d2b-464b-a2d6-a8972d48d571 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:23.069632 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e305aa52-4d2b-464b-a2d6-a8972d48d571 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:23.099145 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-99da9452-9c95-48f9-8112-a0e96c0f9de9 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:23.146779 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-99da9452-9c95-48f9-8112-a0e96c0f9de9 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:23.155497 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-99da9452-9c95-48f9-8112-a0e96c0f9de9 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:23.158323 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-99da9452-9c95-48f9-8112-a0e96c0f9de9 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db" status: 200 len: 1807 microversion: 2.20 time: 0.231673 Aug 27 02:24:23.160026 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 267/535] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:24:22 2022] GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db => generated 1807 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:24:23.258305 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-e305aa52-4d2b-464b-a2d6-a8972d48d571 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fbea2c71674b239e6d8fba6518e962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d9d02db5c49fda33321f2914a7f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:23.267420 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-e305aa52-4d2b-464b-a2d6-a8972d48d571 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1" status: 200 len: 1674 microversion: 2.1 time: 0.212788 Aug 27 02:24:23.268012 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 269/536] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:23 2022] GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1 => generated 1674 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:24:23.326945 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-fc23628b-3ea7-42ff-a0bc-1d36f812f83d tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:23.327947 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-fc23628b-3ea7-42ff-a0bc-1d36f812f83d tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] [instance: 9fb59350-4f09-4e20-bddb-ffc9a65897b3] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:23.338309 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fc23628b-3ea7-42ff-a0bc-1d36f812f83d tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:23.339255 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fc23628b-3ea7-42ff-a0bc-1d36f812f83d tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:23.340714 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fc23628b-3ea7-42ff-a0bc-1d36f812f83d tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:23.342046 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fc23628b-3ea7-42ff-a0bc-1d36f812f83d tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:23.342847 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fc23628b-3ea7-42ff-a0bc-1d36f812f83d tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:23.343570 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fc23628b-3ea7-42ff-a0bc-1d36f812f83d tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:23.506641 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-fc23628b-3ea7-42ff-a0bc-1d36f812f83d tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f53d57f3544e5a25e1beeddab9af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2d4ae1c228446eb5bfc64d44348fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:23.510036 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-f5f9bf42-eb29-4195-bdc6-eb76c725f788 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:23.510652 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-f5f9bf42-eb29-4195-bdc6-eb76c725f788 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] [instance: 49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:23.517128 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f5f9bf42-eb29-4195-bdc6-eb76c725f788 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:23.517653 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f5f9bf42-eb29-4195-bdc6-eb76c725f788 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:23.518091 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f5f9bf42-eb29-4195-bdc6-eb76c725f788 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:23.518791 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f5f9bf42-eb29-4195-bdc6-eb76c725f788 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:23.519264 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f5f9bf42-eb29-4195-bdc6-eb76c725f788 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:23.519668 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f5f9bf42-eb29-4195-bdc6-eb76c725f788 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:23.522593 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-fc23628b-3ea7-42ff-a0bc-1d36f812f83d tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] 10.222.0.61 "GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3" status: 200 len: 1260 microversion: 2.1 time: 0.199736 Aug 27 02:24:23.524555 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 268/537] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:23 2022] GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3 => generated 1260 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:24:23.669828 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-f5f9bf42-eb29-4195-bdc6-eb76c725f788 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931dcabba0214e3daa878f31cd1706cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f956d4d27437c830871f6634a3018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:23.678001 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-f5f9bf42-eb29-4195-bdc6-eb76c725f788 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] 10.222.0.61 "GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8" status: 200 len: 1546 microversion: 2.1 time: 0.171798 Aug 27 02:24:23.678617 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 270/538] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:23 2022] GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8 => generated 1546 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:24:23.699087 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-045962c6-e46a-4a04-b061-5d06eaaf3eff tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:23.699702 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-045962c6-e46a-4a04-b061-5d06eaaf3eff tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] [instance: 49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:23.706201 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-045962c6-e46a-4a04-b061-5d06eaaf3eff tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:23.706666 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-045962c6-e46a-4a04-b061-5d06eaaf3eff tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:23.707138 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-045962c6-e46a-4a04-b061-5d06eaaf3eff tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:23.707895 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-045962c6-e46a-4a04-b061-5d06eaaf3eff tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:23.708396 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-045962c6-e46a-4a04-b061-5d06eaaf3eff tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:23.708858 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-045962c6-e46a-4a04-b061-5d06eaaf3eff tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:23.846202 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-045962c6-e46a-4a04-b061-5d06eaaf3eff tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931dcabba0214e3daa878f31cd1706cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f956d4d27437c830871f6634a3018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:23.859237 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-045962c6-e46a-4a04-b061-5d06eaaf3eff tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] 10.222.0.61 "GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8" status: 200 len: 1546 microversion: 2.1 time: 0.164039 Aug 27 02:24:23.860273 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 269/539] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:23 2022] GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8 => generated 1546 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:24:23.882691 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-3642bb75-abec-44c4-a1e2-702d9b338be3 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:23.886366 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-3642bb75-abec-44c4-a1e2-702d9b338be3 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] [instance: 4e641be3-227d-43c1-aa50-ecf2b89529c9] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:23.892551 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-b2e93456-adc2-4e48-a5d2-f79372330a3c tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:23.899302 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3642bb75-abec-44c4-a1e2-702d9b338be3 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:23.899917 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3642bb75-abec-44c4-a1e2-702d9b338be3 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:23.900454 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3642bb75-abec-44c4-a1e2-702d9b338be3 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:23.900844 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-b2e93456-adc2-4e48-a5d2-f79372330a3c tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '931dcabba0214e3daa878f31cd1706cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f956d4d27437c830871f6634a3018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:23.901363 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3642bb75-abec-44c4-a1e2-702d9b338be3 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:23.901858 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-b2e93456-adc2-4e48-a5d2-f79372330a3c tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Searching by: {'deleted': False, 'project_id': 'fe4f956d4d27437c830871f6634a3018'} {{(pid=120783) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 02:24:23.902094 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3642bb75-abec-44c4-a1e2-702d9b338be3 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:23.902739 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3642bb75-abec-44c4-a1e2-702d9b338be3 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:23.910484 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b2e93456-adc2-4e48-a5d2-f79372330a3c tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:23.911206 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b2e93456-adc2-4e48-a5d2-f79372330a3c tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:23.911877 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b2e93456-adc2-4e48-a5d2-f79372330a3c tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:23.912983 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b2e93456-adc2-4e48-a5d2-f79372330a3c tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:23.913855 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b2e93456-adc2-4e48-a5d2-f79372330a3c tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:23.914443 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b2e93456-adc2-4e48-a5d2-f79372330a3c tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:23.972604 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-3642bb75-abec-44c4-a1e2-702d9b338be3 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f931e726872474dae2b7b6fbb0eb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7bf59244bc487b84c7dbf9aa7314d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:23.981684 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-3642bb75-abec-44c4-a1e2-702d9b338be3 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] 10.222.0.61 "GET /compute/v2.1/servers/4e641be3-227d-43c1-aa50-ecf2b89529c9" status: 200 len: 1271 microversion: 2.1 time: 0.111795 Aug 27 02:24:23.994492 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 271/540] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:23 2022] GET /compute/v2.1/servers/4e641be3-227d-43c1-aa50-ecf2b89529c9 => generated 1271 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:24:24.013932 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.multi_cell_list [None req-b2e93456-adc2-4e48-a5d2-f79372330a3c tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120783) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 02:24:24.030457 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-eb4204e5-cdef-4ded-b1ca-677a0c0f4036 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:24.038842 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-eb4204e5-cdef-4ded-b1ca-677a0c0f4036 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: 268d786c-398a-4305-85ac-545fa3b4370b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:24.046076 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:24:24.053928 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-eb4204e5-cdef-4ded-b1ca-677a0c0f4036 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:24.055171 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-eb4204e5-cdef-4ded-b1ca-677a0c0f4036 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:24.058112 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-eb4204e5-cdef-4ded-b1ca-677a0c0f4036 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:24.059843 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-eb4204e5-cdef-4ded-b1ca-677a0c0f4036 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:24.061608 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-eb4204e5-cdef-4ded-b1ca-677a0c0f4036 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:24.062071 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-eb4204e5-cdef-4ded-b1ca-677a0c0f4036 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:24.138537 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-b2e93456-adc2-4e48-a5d2-f79372330a3c tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] 10.222.0.61 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.253366 Aug 27 02:24:24.143593 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-eb4204e5-cdef-4ded-b1ca-677a0c0f4036 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/268d786c-398a-4305-85ac-545fa3b4370b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.117466 Aug 27 02:24:24.145683 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 272/541] 10.222.0.61 () {58 vars in 1302 bytes} [Sat Aug 27 02:24:24 2022] GET /compute/v2.1/servers/268d786c-398a-4305-85ac-545fa3b4370b/os-volume_attachments => generated 25 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:24:24.146861 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 270/542] 10.222.0.61 () {58 vars in 1125 bytes} [Sat Aug 27 02:24:23 2022] GET /compute/v2.1/servers => generated 342 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:24:24.163387 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-096115f8-2a93-41da-9779-daea6bfd0d03 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:24.165837 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-096115f8-2a93-41da-9779-daea6bfd0d03 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] [instance: 49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:24.176381 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-096115f8-2a93-41da-9779-daea6bfd0d03 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:24.180293 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-096115f8-2a93-41da-9779-daea6bfd0d03 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:24.181330 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-096115f8-2a93-41da-9779-daea6bfd0d03 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:24.182870 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-096115f8-2a93-41da-9779-daea6bfd0d03 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:24.183858 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-096115f8-2a93-41da-9779-daea6bfd0d03 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:24.184875 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-096115f8-2a93-41da-9779-daea6bfd0d03 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:24.186511 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-c0ae42dc-ff42-4c3c-8800-2084a7548947 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:24.187228 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-c0ae42dc-ff42-4c3c-8800-2084a7548947 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:24.194125 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c0ae42dc-ff42-4c3c-8800-2084a7548947 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:24.195167 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c0ae42dc-ff42-4c3c-8800-2084a7548947 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:24.196198 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c0ae42dc-ff42-4c3c-8800-2084a7548947 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:24.197363 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c0ae42dc-ff42-4c3c-8800-2084a7548947 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:24.198083 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c0ae42dc-ff42-4c3c-8800-2084a7548947 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:24.198697 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c0ae42dc-ff42-4c3c-8800-2084a7548947 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:24.353593 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-c0ae42dc-ff42-4c3c-8800-2084a7548947 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:24.358950 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-096115f8-2a93-41da-9779-daea6bfd0d03 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931dcabba0214e3daa878f31cd1706cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f956d4d27437c830871f6634a3018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:24.363577 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-c0ae42dc-ff42-4c3c-8800-2084a7548947 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:24.365119 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-c0ae42dc-ff42-4c3c-8800-2084a7548947 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:24.366485 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-c0ae42dc-ff42-4c3c-8800-2084a7548947 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db" status: 200 len: 1807 microversion: 2.20 time: 0.184753 Aug 27 02:24:24.367176 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 271/543] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:24:24 2022] GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db => generated 1807 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:24:24.368635 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-096115f8-2a93-41da-9779-daea6bfd0d03 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] 10.222.0.61 "GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8" status: 200 len: 1546 microversion: 2.1 time: 0.212568 Aug 27 02:24:24.369419 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 273/544] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:24 2022] GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8 => generated 1546 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:24:24.378878 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-2d3442d6-6245-4298-9c75-fccc4a15b4e1 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:24.379582 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-2d3442d6-6245-4298-9c75-fccc4a15b4e1 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: 268d786c-398a-4305-85ac-545fa3b4370b] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:24.389216 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2d3442d6-6245-4298-9c75-fccc4a15b4e1 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:24.389485 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-df9fb1a4-a239-494a-b182-e735db4ba405 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:24.390043 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2d3442d6-6245-4298-9c75-fccc4a15b4e1 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:24.391133 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-df9fb1a4-a239-494a-b182-e735db4ba405 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 4fedf0d1-cc1c-4947-b92e-dcb4454889d1] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:24.391245 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2d3442d6-6245-4298-9c75-fccc4a15b4e1 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:24.392381 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2d3442d6-6245-4298-9c75-fccc4a15b4e1 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:24.393115 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2d3442d6-6245-4298-9c75-fccc4a15b4e1 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:24.394941 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2d3442d6-6245-4298-9c75-fccc4a15b4e1 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:24.403335 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-df9fb1a4-a239-494a-b182-e735db4ba405 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:24.404187 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-df9fb1a4-a239-494a-b182-e735db4ba405 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:24.405008 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-df9fb1a4-a239-494a-b182-e735db4ba405 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:24.406244 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-df9fb1a4-a239-494a-b182-e735db4ba405 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:24.407098 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-df9fb1a4-a239-494a-b182-e735db4ba405 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:24.407910 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-df9fb1a4-a239-494a-b182-e735db4ba405 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:24.442086 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-2d3442d6-6245-4298-9c75-fccc4a15b4e1 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: 268d786c-398a-4305-85ac-545fa3b4370b] Going to try to terminate instance {{(pid=120783) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:24:24.539267 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-2d3442d6-6245-4298-9c75-fccc4a15b4e1 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "DELETE /compute/v2.1/servers/268d786c-398a-4305-85ac-545fa3b4370b" status: 204 len: 0 microversion: 2.1 time: 0.170408 Aug 27 02:24:24.542763 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 272/545] 10.222.0.61 () {58 vars in 1239 bytes} [Sat Aug 27 02:24:24 2022] DELETE /compute/v2.1/servers/268d786c-398a-4305-85ac-545fa3b4370b => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:24:24.548671 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [req-9b18d5af-dc56-4fde-b86b-b87dccf8d389 req-bfe10319-b5d7-4e2a-8f2b-c7b85796ffad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47d706cc-4f9b-4d59-8eca-caae165ec5db", "name": "network-vif-plugged", "status": "completed", "tag": "118e8d55-f026-4cab-95af-2825721ac127"}]} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:24:24.576341 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-9b18d5af-dc56-4fde-b86b-b87dccf8d389 req-bfe10319-b5d7-4e2a-8f2b-c7b85796ffad service nova] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:24.577566 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-9b18d5af-dc56-4fde-b86b-b87dccf8d389 req-bfe10319-b5d7-4e2a-8f2b-c7b85796ffad service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:24.577847 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-9b18d5af-dc56-4fde-b86b-b87dccf8d389 req-bfe10319-b5d7-4e2a-8f2b-c7b85796ffad service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:24.594015 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.compute.server_external_events [req-9b18d5af-dc56-4fde-b86b-b87dccf8d389 req-bfe10319-b5d7-4e2a-8f2b-c7b85796ffad service nova] Creating event network-vif-plugged:118e8d55-f026-4cab-95af-2825721ac127 for instance 47d706cc-4f9b-4d59-8eca-caae165ec5db on hv-cinder-84630 Aug 27 02:24:24.606622 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [req-9b18d5af-dc56-4fde-b86b-b87dccf8d389 req-bfe10319-b5d7-4e2a-8f2b-c7b85796ffad service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058790 Aug 27 02:24:24.608007 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 273/546] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Aug 27 02:24:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:24:24.614913 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-e4221833-23b4-4d44-9f61-83ea59b07dd5 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:24.615731 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-e4221833-23b4-4d44-9f61-83ea59b07dd5 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] [instance: 9fb59350-4f09-4e20-bddb-ffc9a65897b3] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:24.623237 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e4221833-23b4-4d44-9f61-83ea59b07dd5 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:24.623770 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e4221833-23b4-4d44-9f61-83ea59b07dd5 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:24.624193 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e4221833-23b4-4d44-9f61-83ea59b07dd5 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:24.625137 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e4221833-23b4-4d44-9f61-83ea59b07dd5 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:24.625822 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e4221833-23b4-4d44-9f61-83ea59b07dd5 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:24.629095 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-df9fb1a4-a239-494a-b182-e735db4ba405 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fbea2c71674b239e6d8fba6518e962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d9d02db5c49fda33321f2914a7f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:24.630170 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e4221833-23b4-4d44-9f61-83ea59b07dd5 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:24.637924 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-df9fb1a4-a239-494a-b182-e735db4ba405 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1" status: 200 len: 1674 microversion: 2.1 time: 0.267060 Aug 27 02:24:24.639269 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 274/547] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:24 2022] GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1 => generated 1674 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:24:24.645590 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-ae228b25-39e9-401e-acdb-809d3d4922fe tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:24.646483 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-ae228b25-39e9-401e-acdb-809d3d4922fe tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: 268d786c-398a-4305-85ac-545fa3b4370b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:24.653784 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ae228b25-39e9-401e-acdb-809d3d4922fe tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:24.654603 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ae228b25-39e9-401e-acdb-809d3d4922fe tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:24.655033 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ae228b25-39e9-401e-acdb-809d3d4922fe tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:24.655747 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ae228b25-39e9-401e-acdb-809d3d4922fe tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:24.656194 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ae228b25-39e9-401e-acdb-809d3d4922fe tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:24.656611 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ae228b25-39e9-401e-acdb-809d3d4922fe tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:24.854740 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-e4221833-23b4-4d44-9f61-83ea59b07dd5 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f53d57f3544e5a25e1beeddab9af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2d4ae1c228446eb5bfc64d44348fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:24.864425 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-e4221833-23b4-4d44-9f61-83ea59b07dd5 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] 10.222.0.61 "GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3" status: 200 len: 1260 microversion: 2.1 time: 0.254981 Aug 27 02:24:24.866202 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 274/548] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:24 2022] GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3 => generated 1260 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:24:24.907973 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-ae228b25-39e9-401e-acdb-809d3d4922fe tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6f819365574091ae344f14e47f487f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa1c411b57d4e72885dac2b4f4dfe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:24.917287 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-ae228b25-39e9-401e-acdb-809d3d4922fe tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/268d786c-398a-4305-85ac-545fa3b4370b" status: 200 len: 1682 microversion: 2.1 time: 0.276656 Aug 27 02:24:24.918161 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 275/549] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:24 2022] GET /compute/v2.1/servers/268d786c-398a-4305-85ac-545fa3b4370b => generated 1682 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:24:25.004708 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-61b5e92c-0d63-487a-a114-cba98491fb32 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:25.005205 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-61b5e92c-0d63-487a-a114-cba98491fb32 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] [instance: 4e641be3-227d-43c1-aa50-ecf2b89529c9] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:25.011832 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-61b5e92c-0d63-487a-a114-cba98491fb32 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:25.012328 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-61b5e92c-0d63-487a-a114-cba98491fb32 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:25.012765 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-61b5e92c-0d63-487a-a114-cba98491fb32 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:25.013525 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-61b5e92c-0d63-487a-a114-cba98491fb32 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:25.013992 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-61b5e92c-0d63-487a-a114-cba98491fb32 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:25.014594 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-61b5e92c-0d63-487a-a114-cba98491fb32 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:25.079789 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-61b5e92c-0d63-487a-a114-cba98491fb32 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f931e726872474dae2b7b6fbb0eb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7bf59244bc487b84c7dbf9aa7314d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:25.088229 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-61b5e92c-0d63-487a-a114-cba98491fb32 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] 10.222.0.61 "GET /compute/v2.1/servers/4e641be3-227d-43c1-aa50-ecf2b89529c9" status: 200 len: 1271 microversion: 2.1 time: 0.087666 Aug 27 02:24:25.088831 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 275/550] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:24 2022] GET /compute/v2.1/servers/4e641be3-227d-43c1-aa50-ecf2b89529c9 => generated 1271 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:24:25.391649 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-bd249112-2819-49a3-bde3-e84dbb67539b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:25.392176 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-bd249112-2819-49a3-bde3-e84dbb67539b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:25.399035 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-bd249112-2819-49a3-bde3-e84dbb67539b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:25.399531 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-bd249112-2819-49a3-bde3-e84dbb67539b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:25.399970 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-bd249112-2819-49a3-bde3-e84dbb67539b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:25.400671 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-bd249112-2819-49a3-bde3-e84dbb67539b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:25.401121 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-bd249112-2819-49a3-bde3-e84dbb67539b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:25.401578 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-bd249112-2819-49a3-bde3-e84dbb67539b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:25.553710 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-bd249112-2819-49a3-bde3-e84dbb67539b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:25.568551 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-bd249112-2819-49a3-bde3-e84dbb67539b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:25.572169 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-bd249112-2819-49a3-bde3-e84dbb67539b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:25.574395 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-bd249112-2819-49a3-bde3-e84dbb67539b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db" status: 200 len: 1807 microversion: 2.20 time: 0.186918 Aug 27 02:24:25.575423 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 276/551] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:24:25 2022] GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db => generated 1807 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:24:25.660972 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-e1e8d482-2191-4aee-84ae-feac37d43ba4 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:25.661602 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-e1e8d482-2191-4aee-84ae-feac37d43ba4 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 4fedf0d1-cc1c-4947-b92e-dcb4454889d1] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:25.668856 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e1e8d482-2191-4aee-84ae-feac37d43ba4 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:25.669421 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e1e8d482-2191-4aee-84ae-feac37d43ba4 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:25.669926 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e1e8d482-2191-4aee-84ae-feac37d43ba4 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:25.670664 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e1e8d482-2191-4aee-84ae-feac37d43ba4 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:25.671146 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e1e8d482-2191-4aee-84ae-feac37d43ba4 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:25.671684 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e1e8d482-2191-4aee-84ae-feac37d43ba4 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:25.816680 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-e1e8d482-2191-4aee-84ae-feac37d43ba4 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fbea2c71674b239e6d8fba6518e962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d9d02db5c49fda33321f2914a7f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:25.825138 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-e1e8d482-2191-4aee-84ae-feac37d43ba4 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1" status: 200 len: 1674 microversion: 2.1 time: 0.168422 Aug 27 02:24:25.825761 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 276/552] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:25 2022] GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1 => generated 1674 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:24:25.901812 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-b06f39de-21a1-4b88-a0b5-68b74dfe4c55 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:25.902678 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-b06f39de-21a1-4b88-a0b5-68b74dfe4c55 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] [instance: 9fb59350-4f09-4e20-bddb-ffc9a65897b3] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:25.911857 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b06f39de-21a1-4b88-a0b5-68b74dfe4c55 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:25.912870 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b06f39de-21a1-4b88-a0b5-68b74dfe4c55 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:25.912870 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b06f39de-21a1-4b88-a0b5-68b74dfe4c55 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:25.913341 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b06f39de-21a1-4b88-a0b5-68b74dfe4c55 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:25.913827 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b06f39de-21a1-4b88-a0b5-68b74dfe4c55 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:25.914243 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b06f39de-21a1-4b88-a0b5-68b74dfe4c55 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:25.945573 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-204f5ae7-f814-4d3d-b183-40dda1ba5795 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:25.946489 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-204f5ae7-f814-4d3d-b183-40dda1ba5795 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: 268d786c-398a-4305-85ac-545fa3b4370b] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:25.958055 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-204f5ae7-f814-4d3d-b183-40dda1ba5795 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:25.958055 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-204f5ae7-f814-4d3d-b183-40dda1ba5795 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:25.958689 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-204f5ae7-f814-4d3d-b183-40dda1ba5795 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:25.959520 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-204f5ae7-f814-4d3d-b183-40dda1ba5795 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:25.960105 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-204f5ae7-f814-4d3d-b183-40dda1ba5795 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:25.960610 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-204f5ae7-f814-4d3d-b183-40dda1ba5795 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:26.145829 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-b06f39de-21a1-4b88-a0b5-68b74dfe4c55 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f53d57f3544e5a25e1beeddab9af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2d4ae1c228446eb5bfc64d44348fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:26.152120 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:24:26.164868 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-b06f39de-21a1-4b88-a0b5-68b74dfe4c55 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] 10.222.0.61 "GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3" status: 200 len: 1260 microversion: 2.1 time: 0.266960 Aug 27 02:24:26.165912 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 277/553] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:25 2022] GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3 => generated 1260 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:24:26.189361 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-cef2974e-79b4-40a7-939a-212f2c065fc1 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:26.190357 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-cef2974e-79b4-40a7-939a-212f2c065fc1 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] [instance: 4e641be3-227d-43c1-aa50-ecf2b89529c9] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:26.206317 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cef2974e-79b4-40a7-939a-212f2c065fc1 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:26.207523 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cef2974e-79b4-40a7-939a-212f2c065fc1 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:26.209134 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cef2974e-79b4-40a7-939a-212f2c065fc1 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:26.211415 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cef2974e-79b4-40a7-939a-212f2c065fc1 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:26.212226 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cef2974e-79b4-40a7-939a-212f2c065fc1 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:26.212949 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cef2974e-79b4-40a7-939a-212f2c065fc1 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:26.213148 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-204f5ae7-f814-4d3d-b183-40dda1ba5795 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6f819365574091ae344f14e47f487f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa1c411b57d4e72885dac2b4f4dfe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:26.226316 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-204f5ae7-f814-4d3d-b183-40dda1ba5795 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/268d786c-398a-4305-85ac-545fa3b4370b" status: 200 len: 1682 microversion: 2.1 time: 0.289007 Aug 27 02:24:26.227048 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 277/554] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:25 2022] GET /compute/v2.1/servers/268d786c-398a-4305-85ac-545fa3b4370b => generated 1682 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:24:26.292535 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-7e62d2e0-6483-4bac-a971-0748c84f5b62 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "313ad542-6e20-40f6-ac89-fb7d78a31cab"}} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:24:26.295336 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-7e62d2e0-6483-4bac-a971-0748c84f5b62 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] [instance: 49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:26.297657 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:24:26.304009 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7e62d2e0-6483-4bac-a971-0748c84f5b62 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:26.304502 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7e62d2e0-6483-4bac-a971-0748c84f5b62 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:26.304941 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7e62d2e0-6483-4bac-a971-0748c84f5b62 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:26.305835 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7e62d2e0-6483-4bac-a971-0748c84f5b62 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:26.308755 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7e62d2e0-6483-4bac-a971-0748c84f5b62 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:26.310010 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7e62d2e0-6483-4bac-a971-0748c84f5b62 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:26.324795 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-cef2974e-79b4-40a7-939a-212f2c065fc1 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f931e726872474dae2b7b6fbb0eb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7bf59244bc487b84c7dbf9aa7314d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:26.334130 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-cef2974e-79b4-40a7-939a-212f2c065fc1 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] 10.222.0.61 "GET /compute/v2.1/servers/4e641be3-227d-43c1-aa50-ecf2b89529c9" status: 200 len: 1271 microversion: 2.1 time: 0.166436 Aug 27 02:24:26.334676 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 278/555] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:26 2022] GET /compute/v2.1/servers/4e641be3-227d-43c1-aa50-ecf2b89529c9 => generated 1271 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:24:26.603543 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-8b9539b1-0ea8-4eaa-9378-f2193dc9509d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:26.604700 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-8b9539b1-0ea8-4eaa-9378-f2193dc9509d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:26.615104 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8b9539b1-0ea8-4eaa-9378-f2193dc9509d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:26.615971 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8b9539b1-0ea8-4eaa-9378-f2193dc9509d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:26.616771 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8b9539b1-0ea8-4eaa-9378-f2193dc9509d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:26.618066 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8b9539b1-0ea8-4eaa-9378-f2193dc9509d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:26.618910 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8b9539b1-0ea8-4eaa-9378-f2193dc9509d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:26.619668 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8b9539b1-0ea8-4eaa-9378-f2193dc9509d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:26.829724 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-8b9539b1-0ea8-4eaa-9378-f2193dc9509d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:26.839584 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-8b9539b1-0ea8-4eaa-9378-f2193dc9509d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:26.841314 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-8b9539b1-0ea8-4eaa-9378-f2193dc9509d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:26.842890 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-8b9539b1-0ea8-4eaa-9378-f2193dc9509d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db" status: 200 len: 1807 microversion: 2.20 time: 0.246187 Aug 27 02:24:26.843479 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 279/556] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:24:26 2022] GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db => generated 1807 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:24:26.848161 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-bae73286-2be8-46ca-a7c2-4c579572e73f tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:26.848772 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-bae73286-2be8-46ca-a7c2-4c579572e73f tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 4fedf0d1-cc1c-4947-b92e-dcb4454889d1] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:26.855414 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-bae73286-2be8-46ca-a7c2-4c579572e73f tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:26.855900 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-bae73286-2be8-46ca-a7c2-4c579572e73f tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:26.856337 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-bae73286-2be8-46ca-a7c2-4c579572e73f tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:26.857103 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-bae73286-2be8-46ca-a7c2-4c579572e73f tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:26.857597 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-bae73286-2be8-46ca-a7c2-4c579572e73f tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:26.858021 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-bae73286-2be8-46ca-a7c2-4c579572e73f tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:27.013554 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-bae73286-2be8-46ca-a7c2-4c579572e73f tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fbea2c71674b239e6d8fba6518e962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d9d02db5c49fda33321f2914a7f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:27.022369 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-bae73286-2be8-46ca-a7c2-4c579572e73f tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1" status: 200 len: 1674 microversion: 2.1 time: 0.177794 Aug 27 02:24:27.022964 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 280/557] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:26 2022] GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1 => generated 1674 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:24:27.194773 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-91ab96d4-62ae-4d75-afc2-87755214c830 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:27.195564 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-91ab96d4-62ae-4d75-afc2-87755214c830 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] [instance: 9fb59350-4f09-4e20-bddb-ffc9a65897b3] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:27.203265 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-91ab96d4-62ae-4d75-afc2-87755214c830 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:27.203820 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-91ab96d4-62ae-4d75-afc2-87755214c830 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:27.204317 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-91ab96d4-62ae-4d75-afc2-87755214c830 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:27.205087 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-91ab96d4-62ae-4d75-afc2-87755214c830 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:27.205716 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-91ab96d4-62ae-4d75-afc2-87755214c830 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:27.206208 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-91ab96d4-62ae-4d75-afc2-87755214c830 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:27.373725 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-91ab96d4-62ae-4d75-afc2-87755214c830 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f53d57f3544e5a25e1beeddab9af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2d4ae1c228446eb5bfc64d44348fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:27.382135 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-91ab96d4-62ae-4d75-afc2-87755214c830 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] 10.222.0.61 "GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3" status: 200 len: 1260 microversion: 2.1 time: 0.191311 Aug 27 02:24:27.382725 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 281/558] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:27 2022] GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3 => generated 1260 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:24:27.387982 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-59394aa6-7d42-4b9d-ac50-d0a1ab6c0d42 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:27.388584 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-59394aa6-7d42-4b9d-ac50-d0a1ab6c0d42 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: 268d786c-398a-4305-85ac-545fa3b4370b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:27.395284 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-59394aa6-7d42-4b9d-ac50-d0a1ab6c0d42 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:27.395783 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-59394aa6-7d42-4b9d-ac50-d0a1ab6c0d42 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:27.396214 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-59394aa6-7d42-4b9d-ac50-d0a1ab6c0d42 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:27.396920 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-59394aa6-7d42-4b9d-ac50-d0a1ab6c0d42 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:27.397372 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-59394aa6-7d42-4b9d-ac50-d0a1ab6c0d42 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:27.397838 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-59394aa6-7d42-4b9d-ac50-d0a1ab6c0d42 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:27.568463 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-59394aa6-7d42-4b9d-ac50-d0a1ab6c0d42 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6f819365574091ae344f14e47f487f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa1c411b57d4e72885dac2b4f4dfe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:27.582725 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-59394aa6-7d42-4b9d-ac50-d0a1ab6c0d42 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/268d786c-398a-4305-85ac-545fa3b4370b" status: 200 len: 1682 microversion: 2.1 time: 0.198440 Aug 27 02:24:27.583654 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 282/559] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:27 2022] GET /compute/v2.1/servers/268d786c-398a-4305-85ac-545fa3b4370b => generated 1682 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:24:27.593926 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-38e6b1d9-f6e6-4ad0-97c8-3b88c1e83ac5 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:24:27.597985 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-38e6b1d9-f6e6-4ad0-97c8-3b88c1e83ac5 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 1b9390be-aab0-4240-83d9-0f815f094605] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:27.608743 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-38e6b1d9-f6e6-4ad0-97c8-3b88c1e83ac5 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:27.609555 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-38e6b1d9-f6e6-4ad0-97c8-3b88c1e83ac5 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:27.610266 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-38e6b1d9-f6e6-4ad0-97c8-3b88c1e83ac5 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:27.611501 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-38e6b1d9-f6e6-4ad0-97c8-3b88c1e83ac5 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:27.612296 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-38e6b1d9-f6e6-4ad0-97c8-3b88c1e83ac5 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:27.613039 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-38e6b1d9-f6e6-4ad0-97c8-3b88c1e83ac5 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:27.643580 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.objects.instance [None req-38e6b1d9-f6e6-4ad0-97c8-3b88c1e83ac5 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lazy-loading 'flavor' on Instance uuid 1b9390be-aab0-4240-83d9-0f815f094605 {{(pid=120782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:24:27.808077 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-38e6b1d9-f6e6-4ad0-97c8-3b88c1e83ac5 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "POST /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605/action" status: 200 len: 32 microversion: 2.1 time: 0.221882 Aug 27 02:24:27.808711 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 283/560] 10.222.0.61 () {60 vars in 1278 bytes} [Sat Aug 27 02:24:27 2022] POST /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605/action => generated 32 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:24:27.814259 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-f7967ba9-4b1e-4eac-b403-ac105ff61386 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:27.814915 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-f7967ba9-4b1e-4eac-b403-ac105ff61386 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] [instance: 4e641be3-227d-43c1-aa50-ecf2b89529c9] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:27.816996 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:24:27.824202 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f7967ba9-4b1e-4eac-b403-ac105ff61386 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:27.824820 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f7967ba9-4b1e-4eac-b403-ac105ff61386 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:27.825260 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f7967ba9-4b1e-4eac-b403-ac105ff61386 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:27.826021 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f7967ba9-4b1e-4eac-b403-ac105ff61386 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:27.826483 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f7967ba9-4b1e-4eac-b403-ac105ff61386 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:27.826907 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f7967ba9-4b1e-4eac-b403-ac105ff61386 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:27.909464 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-f7967ba9-4b1e-4eac-b403-ac105ff61386 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f931e726872474dae2b7b6fbb0eb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7bf59244bc487b84c7dbf9aa7314d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:27.923686 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-f7967ba9-4b1e-4eac-b403-ac105ff61386 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] 10.222.0.61 "GET /compute/v2.1/servers/4e641be3-227d-43c1-aa50-ecf2b89529c9" status: 200 len: 1271 microversion: 2.1 time: 0.113701 Aug 27 02:24:27.924610 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 284/561] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:27 2022] GET /compute/v2.1/servers/4e641be3-227d-43c1-aa50-ecf2b89529c9 => generated 1271 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:24:27.933464 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-3e9860b9-1fab-4039-8782-d34ed2985633 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:27.934012 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-3e9860b9-1fab-4039-8782-d34ed2985633 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 1b9390be-aab0-4240-83d9-0f815f094605] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:27.943129 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3e9860b9-1fab-4039-8782-d34ed2985633 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:27.943721 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3e9860b9-1fab-4039-8782-d34ed2985633 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:27.944228 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3e9860b9-1fab-4039-8782-d34ed2985633 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:27.945008 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3e9860b9-1fab-4039-8782-d34ed2985633 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:27.945622 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3e9860b9-1fab-4039-8782-d34ed2985633 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:27.946345 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3e9860b9-1fab-4039-8782-d34ed2985633 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:28.129384 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-7e62d2e0-6483-4bac-a971-0748c84f5b62 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] 10.222.0.61 "POST /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.840980 Aug 27 02:24:28.130814 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 278/562] 10.222.0.61 () {60 vars in 1323 bytes} [Sat Aug 27 02:24:26 2022] POST /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8/os-volume_attachments => generated 194 bytes in 1843 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:24:28.140703 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-2c98db48-493c-4570-8266-eb685557a2c7 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:28.142357 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-2c98db48-493c-4570-8266-eb685557a2c7 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:28.153300 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2c98db48-493c-4570-8266-eb685557a2c7 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:28.154124 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2c98db48-493c-4570-8266-eb685557a2c7 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:28.154858 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2c98db48-493c-4570-8266-eb685557a2c7 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:28.155920 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2c98db48-493c-4570-8266-eb685557a2c7 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:28.156626 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2c98db48-493c-4570-8266-eb685557a2c7 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:28.157267 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2c98db48-493c-4570-8266-eb685557a2c7 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:28.176745 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-3e9860b9-1fab-4039-8782-d34ed2985633 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:28.186070 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-3e9860b9-1fab-4039-8782-d34ed2985633 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605" status: 200 len: 1734 microversion: 2.1 time: 0.259962 Aug 27 02:24:28.186649 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 285/563] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:27 2022] GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605 => generated 1734 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:24:28.192013 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-e1894c9a-5e14-451f-8c25-4c85b499f0f7 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:28.192870 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-e1894c9a-5e14-451f-8c25-4c85b499f0f7 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 4fedf0d1-cc1c-4947-b92e-dcb4454889d1] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:28.199449 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e1894c9a-5e14-451f-8c25-4c85b499f0f7 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:28.200258 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e1894c9a-5e14-451f-8c25-4c85b499f0f7 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:28.201114 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e1894c9a-5e14-451f-8c25-4c85b499f0f7 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:28.202019 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e1894c9a-5e14-451f-8c25-4c85b499f0f7 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:28.202650 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e1894c9a-5e14-451f-8c25-4c85b499f0f7 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:28.203276 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e1894c9a-5e14-451f-8c25-4c85b499f0f7 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:28.349383 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-2c98db48-493c-4570-8266-eb685557a2c7 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:28.370042 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-2c98db48-493c-4570-8266-eb685557a2c7 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:28.373078 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-2c98db48-493c-4570-8266-eb685557a2c7 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:28.375392 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-2c98db48-493c-4570-8266-eb685557a2c7 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db" status: 200 len: 1807 microversion: 2.20 time: 0.242242 Aug 27 02:24:28.376303 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-e1894c9a-5e14-451f-8c25-4c85b499f0f7 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fbea2c71674b239e6d8fba6518e962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d9d02db5c49fda33321f2914a7f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:28.376793 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 279/564] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:24:28 2022] GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db => generated 1807 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:24:28.384426 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-e1894c9a-5e14-451f-8c25-4c85b499f0f7 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1" status: 200 len: 1674 microversion: 2.1 time: 0.196465 Aug 27 02:24:28.385287 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 286/565] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:28 2022] GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1 => generated 1674 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:24:28.414387 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-2457d962-07ed-407a-8dc4-46fd65a0d542 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:28.414998 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-2457d962-07ed-407a-8dc4-46fd65a0d542 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] [instance: 9fb59350-4f09-4e20-bddb-ffc9a65897b3] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:28.421117 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2457d962-07ed-407a-8dc4-46fd65a0d542 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:28.421644 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2457d962-07ed-407a-8dc4-46fd65a0d542 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:28.422076 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2457d962-07ed-407a-8dc4-46fd65a0d542 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:28.422772 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2457d962-07ed-407a-8dc4-46fd65a0d542 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:28.423221 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2457d962-07ed-407a-8dc4-46fd65a0d542 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:28.423641 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2457d962-07ed-407a-8dc4-46fd65a0d542 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:28.605629 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-f6459082-50d7-40e0-89c7-3fbc1e453967 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:28.606159 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-f6459082-50d7-40e0-89c7-3fbc1e453967 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: 268d786c-398a-4305-85ac-545fa3b4370b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:28.616888 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f6459082-50d7-40e0-89c7-3fbc1e453967 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:28.617436 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f6459082-50d7-40e0-89c7-3fbc1e453967 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:28.617879 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f6459082-50d7-40e0-89c7-3fbc1e453967 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:28.618588 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f6459082-50d7-40e0-89c7-3fbc1e453967 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:28.619483 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f6459082-50d7-40e0-89c7-3fbc1e453967 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:28.620081 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f6459082-50d7-40e0-89c7-3fbc1e453967 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:28.769031 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-f6459082-50d7-40e0-89c7-3fbc1e453967 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6f819365574091ae344f14e47f487f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa1c411b57d4e72885dac2b4f4dfe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:28.778269 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-f6459082-50d7-40e0-89c7-3fbc1e453967 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/268d786c-398a-4305-85ac-545fa3b4370b" status: 200 len: 1682 microversion: 2.1 time: 0.176777 Aug 27 02:24:28.778820 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 287/566] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:28 2022] GET /compute/v2.1/servers/268d786c-398a-4305-85ac-545fa3b4370b => generated 1682 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:24:28.815670 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-2457d962-07ed-407a-8dc4-46fd65a0d542 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f53d57f3544e5a25e1beeddab9af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2d4ae1c228446eb5bfc64d44348fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:28.824484 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-2457d962-07ed-407a-8dc4-46fd65a0d542 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] 10.222.0.61 "GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3" status: 200 len: 1260 microversion: 2.1 time: 0.413865 Aug 27 02:24:28.825052 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 280/567] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:28 2022] GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3 => generated 1260 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:24:28.944839 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-f23628aa-d6fd-473a-bba7-412e0e8b74ff tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:28.945339 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-f23628aa-d6fd-473a-bba7-412e0e8b74ff tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] [instance: 4e641be3-227d-43c1-aa50-ecf2b89529c9] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:28.953654 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f23628aa-d6fd-473a-bba7-412e0e8b74ff tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:28.955159 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f23628aa-d6fd-473a-bba7-412e0e8b74ff tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:28.955653 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f23628aa-d6fd-473a-bba7-412e0e8b74ff tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:28.956388 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f23628aa-d6fd-473a-bba7-412e0e8b74ff tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:28.956854 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f23628aa-d6fd-473a-bba7-412e0e8b74ff tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:28.957296 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f23628aa-d6fd-473a-bba7-412e0e8b74ff tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:29.026992 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-f23628aa-d6fd-473a-bba7-412e0e8b74ff tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f931e726872474dae2b7b6fbb0eb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7bf59244bc487b84c7dbf9aa7314d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:29.038835 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-f23628aa-d6fd-473a-bba7-412e0e8b74ff tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] 10.222.0.61 "GET /compute/v2.1/servers/4e641be3-227d-43c1-aa50-ecf2b89529c9" status: 200 len: 1279 microversion: 2.1 time: 0.097850 Aug 27 02:24:29.039857 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 288/568] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:28 2022] GET /compute/v2.1/servers/4e641be3-227d-43c1-aa50-ecf2b89529c9 => generated 1279 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:24:29.228485 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-875f2660-041a-4494-9a60-4c8de8965d16 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:29.229858 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-875f2660-041a-4494-9a60-4c8de8965d16 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 1b9390be-aab0-4240-83d9-0f815f094605] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:29.263902 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-875f2660-041a-4494-9a60-4c8de8965d16 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:29.264857 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-875f2660-041a-4494-9a60-4c8de8965d16 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:29.265644 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-875f2660-041a-4494-9a60-4c8de8965d16 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:29.268447 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-875f2660-041a-4494-9a60-4c8de8965d16 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:29.270095 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-875f2660-041a-4494-9a60-4c8de8965d16 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:29.271249 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-875f2660-041a-4494-9a60-4c8de8965d16 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:29.410746 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-947eb606-a47c-4f9a-8cb7-9653e9dbae22 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:29.411599 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-947eb606-a47c-4f9a-8cb7-9653e9dbae22 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:29.420603 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-947eb606-a47c-4f9a-8cb7-9653e9dbae22 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:29.421335 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-947eb606-a47c-4f9a-8cb7-9653e9dbae22 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:29.422061 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-947eb606-a47c-4f9a-8cb7-9653e9dbae22 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:29.422959 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-947eb606-a47c-4f9a-8cb7-9653e9dbae22 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:29.423813 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-947eb606-a47c-4f9a-8cb7-9653e9dbae22 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:29.424467 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-947eb606-a47c-4f9a-8cb7-9653e9dbae22 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:29.697705 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-947eb606-a47c-4f9a-8cb7-9653e9dbae22 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:29.713477 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-947eb606-a47c-4f9a-8cb7-9653e9dbae22 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:29.714737 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-875f2660-041a-4494-9a60-4c8de8965d16 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:29.714959 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-947eb606-a47c-4f9a-8cb7-9653e9dbae22 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:29.716345 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-947eb606-a47c-4f9a-8cb7-9653e9dbae22 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db" status: 200 len: 1807 microversion: 2.20 time: 0.312120 Aug 27 02:24:29.725388 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-875f2660-041a-4494-9a60-4c8de8965d16 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605" status: 200 len: 1734 microversion: 2.1 time: 0.508199 Aug 27 02:24:29.726616 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 281/569] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:29 2022] GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605 => generated 1734 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:24:29.730912 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 289/570] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:24:29 2022] GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db => generated 1807 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:24:29.731743 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-7b7ea74a-8b6a-4f13-b32d-b0a725c2844b tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:29.732600 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-7b7ea74a-8b6a-4f13-b32d-b0a725c2844b tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 4fedf0d1-cc1c-4947-b92e-dcb4454889d1] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:29.739058 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7b7ea74a-8b6a-4f13-b32d-b0a725c2844b tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:29.739551 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7b7ea74a-8b6a-4f13-b32d-b0a725c2844b tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:29.740162 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7b7ea74a-8b6a-4f13-b32d-b0a725c2844b tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:29.740882 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7b7ea74a-8b6a-4f13-b32d-b0a725c2844b tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:29.741544 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7b7ea74a-8b6a-4f13-b32d-b0a725c2844b tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:29.741979 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7b7ea74a-8b6a-4f13-b32d-b0a725c2844b tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:29.803203 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-84c122de-e0d9-4ccb-a72c-f71dcbd2e542 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:29.804410 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-84c122de-e0d9-4ccb-a72c-f71dcbd2e542 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: 268d786c-398a-4305-85ac-545fa3b4370b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:29.812396 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-84c122de-e0d9-4ccb-a72c-f71dcbd2e542 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:29.812862 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-84c122de-e0d9-4ccb-a72c-f71dcbd2e542 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:29.813265 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-84c122de-e0d9-4ccb-a72c-f71dcbd2e542 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:29.814172 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-84c122de-e0d9-4ccb-a72c-f71dcbd2e542 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:29.814628 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-84c122de-e0d9-4ccb-a72c-f71dcbd2e542 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:29.815077 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-84c122de-e0d9-4ccb-a72c-f71dcbd2e542 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:29.898594 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-84c122de-e0d9-4ccb-a72c-f71dcbd2e542 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6f819365574091ae344f14e47f487f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa1c411b57d4e72885dac2b4f4dfe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:29.918524 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-84c122de-e0d9-4ccb-a72c-f71dcbd2e542 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/268d786c-398a-4305-85ac-545fa3b4370b" status: 200 len: 1615 microversion: 2.1 time: 0.119730 Aug 27 02:24:29.929506 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 290/571] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:29 2022] GET /compute/v2.1/servers/268d786c-398a-4305-85ac-545fa3b4370b => generated 1615 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:24:29.937111 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-028687dd-1fad-4b62-b643-fd2afe47c51e tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:29.938741 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-028687dd-1fad-4b62-b643-fd2afe47c51e tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] [instance: 9fb59350-4f09-4e20-bddb-ffc9a65897b3] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:29.947281 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-028687dd-1fad-4b62-b643-fd2afe47c51e tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:29.947960 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-028687dd-1fad-4b62-b643-fd2afe47c51e tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:29.948507 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-028687dd-1fad-4b62-b643-fd2afe47c51e tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:29.949360 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-028687dd-1fad-4b62-b643-fd2afe47c51e tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:29.949976 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-028687dd-1fad-4b62-b643-fd2afe47c51e tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:29.950503 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-028687dd-1fad-4b62-b643-fd2afe47c51e tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:30.119246 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-7b7ea74a-8b6a-4f13-b32d-b0a725c2844b tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fbea2c71674b239e6d8fba6518e962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d9d02db5c49fda33321f2914a7f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:30.131348 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-7b7ea74a-8b6a-4f13-b32d-b0a725c2844b tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1" status: 200 len: 1674 microversion: 2.1 time: 0.403430 Aug 27 02:24:30.143142 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 282/572] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:29 2022] GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1 => generated 1674 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:24:30.143142 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-e458e3b8-b530-4a94-b021-8ff405a75484 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:30.143142 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-e458e3b8-b530-4a94-b021-8ff405a75484 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] [instance: 4e641be3-227d-43c1-aa50-ecf2b89529c9] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:30.151630 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e458e3b8-b530-4a94-b021-8ff405a75484 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:30.152945 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e458e3b8-b530-4a94-b021-8ff405a75484 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:30.153517 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e458e3b8-b530-4a94-b021-8ff405a75484 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:30.154353 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e458e3b8-b530-4a94-b021-8ff405a75484 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:30.154910 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e458e3b8-b530-4a94-b021-8ff405a75484 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:30.155453 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e458e3b8-b530-4a94-b021-8ff405a75484 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:30.235073 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-028687dd-1fad-4b62-b643-fd2afe47c51e tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f53d57f3544e5a25e1beeddab9af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2d4ae1c228446eb5bfc64d44348fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:30.245005 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-028687dd-1fad-4b62-b643-fd2afe47c51e tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] 10.222.0.61 "GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3" status: 200 len: 1445 microversion: 2.1 time: 0.324059 Aug 27 02:24:30.259153 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-e458e3b8-b530-4a94-b021-8ff405a75484 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f931e726872474dae2b7b6fbb0eb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7bf59244bc487b84c7dbf9aa7314d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:30.262500 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 291/573] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:29 2022] GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3 => generated 1445 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:24:30.270014 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-a376889e-eab5-4dd9-af61-f9d37b5a0ce8 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:30.272640 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-a376889e-eab5-4dd9-af61-f9d37b5a0ce8 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] [instance: 9fb59350-4f09-4e20-bddb-ffc9a65897b3] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:30.284792 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a376889e-eab5-4dd9-af61-f9d37b5a0ce8 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:30.285723 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a376889e-eab5-4dd9-af61-f9d37b5a0ce8 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:30.286394 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a376889e-eab5-4dd9-af61-f9d37b5a0ce8 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:30.287356 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a376889e-eab5-4dd9-af61-f9d37b5a0ce8 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:30.288023 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a376889e-eab5-4dd9-af61-f9d37b5a0ce8 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:30.288662 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a376889e-eab5-4dd9-af61-f9d37b5a0ce8 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:30.295294 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-e458e3b8-b530-4a94-b021-8ff405a75484 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] 10.222.0.61 "GET /compute/v2.1/servers/4e641be3-227d-43c1-aa50-ecf2b89529c9" status: 200 len: 1277 microversion: 2.1 time: 0.160165 Aug 27 02:24:30.316960 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 283/574] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:30 2022] GET /compute/v2.1/servers/4e641be3-227d-43c1-aa50-ecf2b89529c9 => generated 1277 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:24:30.329715 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:24:30.386261 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [req-bfd9e961-cda9-490c-af12-694f557a89ef req-64a15c6e-f2d8-406f-b2a7-c6946a737ca9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "268d786c-398a-4305-85ac-545fa3b4370b", "name": "network-vif-deleted", "tag": "74ca1c59-a918-4f05-94e1-8a42c24359ab"}]} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:24:30.397195 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-bfd9e961-cda9-490c-af12-694f557a89ef req-64a15c6e-f2d8-406f-b2a7-c6946a737ca9 service nova] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:30.398010 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-bfd9e961-cda9-490c-af12-694f557a89ef req-64a15c6e-f2d8-406f-b2a7-c6946a737ca9 service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:30.398498 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-bfd9e961-cda9-490c-af12-694f557a89ef req-64a15c6e-f2d8-406f-b2a7-c6946a737ca9 service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:30.433056 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.compute.server_external_events [req-bfd9e961-cda9-490c-af12-694f557a89ef req-64a15c6e-f2d8-406f-b2a7-c6946a737ca9 service nova] Creating event network-vif-deleted:74ca1c59-a918-4f05-94e1-8a42c24359ab for instance 268d786c-398a-4305-85ac-545fa3b4370b on hv-cinder-84630 Aug 27 02:24:30.439761 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [req-bfd9e961-cda9-490c-af12-694f557a89ef req-64a15c6e-f2d8-406f-b2a7-c6946a737ca9 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057278 Aug 27 02:24:30.440745 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 284/575] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Aug 27 02:24:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:24:30.577152 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-a376889e-eab5-4dd9-af61-f9d37b5a0ce8 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f53d57f3544e5a25e1beeddab9af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2d4ae1c228446eb5bfc64d44348fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:30.596377 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-a376889e-eab5-4dd9-af61-f9d37b5a0ce8 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] 10.222.0.61 "GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3" status: 200 len: 1445 microversion: 2.1 time: 0.332381 Aug 27 02:24:30.597113 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 292/576] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:30 2022] GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3 => generated 1445 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:24:30.742950 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-ba35ee5b-1eb4-4887-a4fb-8d2a5c667254 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:30.742950 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-ba35ee5b-1eb4-4887-a4fb-8d2a5c667254 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:30.750784 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-df543c08-2cb2-4c3f-a620-d8e6518d23e1 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:30.751433 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-df543c08-2cb2-4c3f-a620-d8e6518d23e1 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 1b9390be-aab0-4240-83d9-0f815f094605] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:30.780005 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-df543c08-2cb2-4c3f-a620-d8e6518d23e1 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:30.780516 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-df543c08-2cb2-4c3f-a620-d8e6518d23e1 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:30.781309 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ba35ee5b-1eb4-4887-a4fb-8d2a5c667254 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:30.781874 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ba35ee5b-1eb4-4887-a4fb-8d2a5c667254 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:30.784251 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ba35ee5b-1eb4-4887-a4fb-8d2a5c667254 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:30.784953 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ba35ee5b-1eb4-4887-a4fb-8d2a5c667254 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:30.785499 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ba35ee5b-1eb4-4887-a4fb-8d2a5c667254 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:30.786746 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-df543c08-2cb2-4c3f-a620-d8e6518d23e1 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:30.792008 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-df543c08-2cb2-4c3f-a620-d8e6518d23e1 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:30.792464 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-df543c08-2cb2-4c3f-a620-d8e6518d23e1 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:30.792905 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-df543c08-2cb2-4c3f-a620-d8e6518d23e1 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:30.795982 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ba35ee5b-1eb4-4887-a4fb-8d2a5c667254 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:30.811910 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:24:31.080188 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-ba35ee5b-1eb4-4887-a4fb-8d2a5c667254 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:31.107954 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-ba35ee5b-1eb4-4887-a4fb-8d2a5c667254 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:31.111224 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-ba35ee5b-1eb4-4887-a4fb-8d2a5c667254 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:31.114042 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-ba35ee5b-1eb4-4887-a4fb-8d2a5c667254 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db" status: 200 len: 1807 microversion: 2.20 time: 0.376284 Aug 27 02:24:31.115342 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 285/577] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:24:30 2022] GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db => generated 1807 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:24:31.125880 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-07280ddd-2e6c-484f-84ea-1c1a7ef6b7e6 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:31.127158 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-07280ddd-2e6c-484f-84ea-1c1a7ef6b7e6 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: 268d786c-398a-4305-85ac-545fa3b4370b] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:31.140102 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-07280ddd-2e6c-484f-84ea-1c1a7ef6b7e6 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:31.141356 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-07280ddd-2e6c-484f-84ea-1c1a7ef6b7e6 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:31.142258 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-07280ddd-2e6c-484f-84ea-1c1a7ef6b7e6 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:31.143188 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-07280ddd-2e6c-484f-84ea-1c1a7ef6b7e6 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:31.143851 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-07280ddd-2e6c-484f-84ea-1c1a7ef6b7e6 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:31.144481 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-07280ddd-2e6c-484f-84ea-1c1a7ef6b7e6 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:31.188818 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-07280ddd-2e6c-484f-84ea-1c1a7ef6b7e6 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:31.190027 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-07280ddd-2e6c-484f-84ea-1c1a7ef6b7e6 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:31.190757 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-07280ddd-2e6c-484f-84ea-1c1a7ef6b7e6 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:31.191299 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.objects.instance [None req-07280ddd-2e6c-484f-84ea-1c1a7ef6b7e6 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lazy-loading 'fault' on Instance uuid 268d786c-398a-4305-85ac-545fa3b4370b {{(pid=120783) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:24:31.246802 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-07280ddd-2e6c-484f-84ea-1c1a7ef6b7e6 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6f819365574091ae344f14e47f487f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa1c411b57d4e72885dac2b4f4dfe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:31.262590 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-07280ddd-2e6c-484f-84ea-1c1a7ef6b7e6 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/268d786c-398a-4305-85ac-545fa3b4370b" status: 200 len: 1332 microversion: 2.1 time: 0.145133 Aug 27 02:24:31.269993 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 286/578] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:31 2022] GET /compute/v2.1/servers/268d786c-398a-4305-85ac-545fa3b4370b => generated 1332 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:24:31.279937 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-2e58878a-d4f0-4199-81be-f66dce823c0e tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:31.281283 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-2e58878a-d4f0-4199-81be-f66dce823c0e tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 4fedf0d1-cc1c-4947-b92e-dcb4454889d1] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:31.294013 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2e58878a-d4f0-4199-81be-f66dce823c0e tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:31.296133 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2e58878a-d4f0-4199-81be-f66dce823c0e tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:31.297317 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2e58878a-d4f0-4199-81be-f66dce823c0e tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:31.298877 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2e58878a-d4f0-4199-81be-f66dce823c0e tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:31.300078 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2e58878a-d4f0-4199-81be-f66dce823c0e tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:31.301031 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2e58878a-d4f0-4199-81be-f66dce823c0e tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:31.310096 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-df543c08-2cb2-4c3f-a620-d8e6518d23e1 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:31.324852 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-df543c08-2cb2-4c3f-a620-d8e6518d23e1 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605" status: 200 len: 1734 microversion: 2.1 time: 0.578425 Aug 27 02:24:31.327701 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 293/579] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:30 2022] GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605 => generated 1734 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:24:31.341594 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-4a271033-6bf2-45d5-9f34-75af29278045 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:31.344440 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-4a271033-6bf2-45d5-9f34-75af29278045 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] [instance: 4e641be3-227d-43c1-aa50-ecf2b89529c9] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:31.354813 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4a271033-6bf2-45d5-9f34-75af29278045 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:31.362643 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4a271033-6bf2-45d5-9f34-75af29278045 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:31.363263 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4a271033-6bf2-45d5-9f34-75af29278045 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:31.364237 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4a271033-6bf2-45d5-9f34-75af29278045 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:31.365037 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4a271033-6bf2-45d5-9f34-75af29278045 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:31.368528 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4a271033-6bf2-45d5-9f34-75af29278045 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:31.640226 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-2e58878a-d4f0-4199-81be-f66dce823c0e tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fbea2c71674b239e6d8fba6518e962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d9d02db5c49fda33321f2914a7f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:31.656016 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-2e58878a-d4f0-4199-81be-f66dce823c0e tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1" status: 200 len: 1674 microversion: 2.1 time: 0.383834 Aug 27 02:24:31.657673 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 287/580] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:31 2022] GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1 => generated 1674 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:24:32.091675 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-4a271033-6bf2-45d5-9f34-75af29278045 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f931e726872474dae2b7b6fbb0eb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7bf59244bc487b84c7dbf9aa7314d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:32.101513 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-4a271033-6bf2-45d5-9f34-75af29278045 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] 10.222.0.61 "GET /compute/v2.1/servers/4e641be3-227d-43c1-aa50-ecf2b89529c9" status: 200 len: 1319 microversion: 2.1 time: 0.772561 Aug 27 02:24:32.102481 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 294/581] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:31 2022] GET /compute/v2.1/servers/4e641be3-227d-43c1-aa50-ecf2b89529c9 => generated 1319 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:24:32.142434 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-3d91c547-7664-4258-b2cc-06d3553c2b9a tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:32.143087 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-3d91c547-7664-4258-b2cc-06d3553c2b9a tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:32.151156 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3d91c547-7664-4258-b2cc-06d3553c2b9a tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:32.151675 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3d91c547-7664-4258-b2cc-06d3553c2b9a tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:32.152113 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3d91c547-7664-4258-b2cc-06d3553c2b9a tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:32.152812 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3d91c547-7664-4258-b2cc-06d3553c2b9a tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:32.153362 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3d91c547-7664-4258-b2cc-06d3553c2b9a tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:32.153808 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3d91c547-7664-4258-b2cc-06d3553c2b9a tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:32.303343 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-f24bfc59-4f54-4352-828a-5663947487bc tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:32.307803 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-f24bfc59-4f54-4352-828a-5663947487bc tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: 268d786c-398a-4305-85ac-545fa3b4370b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:32.322655 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f24bfc59-4f54-4352-828a-5663947487bc tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:32.324041 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f24bfc59-4f54-4352-828a-5663947487bc tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:32.325192 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f24bfc59-4f54-4352-828a-5663947487bc tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:32.326358 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f24bfc59-4f54-4352-828a-5663947487bc tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:32.327050 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f24bfc59-4f54-4352-828a-5663947487bc tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:32.327789 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f24bfc59-4f54-4352-828a-5663947487bc tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:32.386700 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f24bfc59-4f54-4352-828a-5663947487bc tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:32.387328 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f24bfc59-4f54-4352-828a-5663947487bc tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:32.387743 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-3d91c547-7664-4258-b2cc-06d3553c2b9a tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:32.388238 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f24bfc59-4f54-4352-828a-5663947487bc tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:32.388499 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.objects.instance [None req-f24bfc59-4f54-4352-828a-5663947487bc tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lazy-loading 'fault' on Instance uuid 268d786c-398a-4305-85ac-545fa3b4370b {{(pid=120782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:24:32.401094 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-3d91c547-7664-4258-b2cc-06d3553c2b9a tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:32.402784 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-3d91c547-7664-4258-b2cc-06d3553c2b9a tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:32.403972 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-3d91c547-7664-4258-b2cc-06d3553c2b9a tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db" status: 200 len: 1794 microversion: 2.20 time: 0.266860 Aug 27 02:24:32.404625 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 288/582] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:24:32 2022] GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db => generated 1794 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:24:32.409291 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-50627f4d-81bd-4dab-8704-a580fb134282 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:32.410086 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-50627f4d-81bd-4dab-8704-a580fb134282 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 1b9390be-aab0-4240-83d9-0f815f094605] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:32.419940 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-50627f4d-81bd-4dab-8704-a580fb134282 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:32.420984 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-50627f4d-81bd-4dab-8704-a580fb134282 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:32.422036 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-50627f4d-81bd-4dab-8704-a580fb134282 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:32.423434 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-50627f4d-81bd-4dab-8704-a580fb134282 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:32.424364 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-50627f4d-81bd-4dab-8704-a580fb134282 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:32.425052 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-50627f4d-81bd-4dab-8704-a580fb134282 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:32.482928 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-f24bfc59-4f54-4352-828a-5663947487bc tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6f819365574091ae344f14e47f487f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa1c411b57d4e72885dac2b4f4dfe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:32.516613 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-f24bfc59-4f54-4352-828a-5663947487bc tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/268d786c-398a-4305-85ac-545fa3b4370b" status: 200 len: 1332 microversion: 2.1 time: 0.222564 Aug 27 02:24:32.520961 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 295/583] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:32 2022] GET /compute/v2.1/servers/268d786c-398a-4305-85ac-545fa3b4370b => generated 1332 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:24:32.672700 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-50627f4d-81bd-4dab-8704-a580fb134282 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:32.679576 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-940a3108-ee5e-4594-8d06-968940962b52 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:32.680564 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-940a3108-ee5e-4594-8d06-968940962b52 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 4fedf0d1-cc1c-4947-b92e-dcb4454889d1] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:32.686293 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-50627f4d-81bd-4dab-8704-a580fb134282 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605" status: 200 len: 1734 microversion: 2.1 time: 0.280553 Aug 27 02:24:32.688015 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 289/584] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:32 2022] GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605 => generated 1734 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:24:32.697479 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-940a3108-ee5e-4594-8d06-968940962b52 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:32.698989 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-940a3108-ee5e-4594-8d06-968940962b52 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:32.699865 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-940a3108-ee5e-4594-8d06-968940962b52 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:32.701937 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-940a3108-ee5e-4594-8d06-968940962b52 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:32.702625 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-940a3108-ee5e-4594-8d06-968940962b52 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:32.703273 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-940a3108-ee5e-4594-8d06-968940962b52 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:32.900777 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-669084b0-dce0-4ed2-a1ab-babc4b722886 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:32.901385 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-669084b0-dce0-4ed2-a1ab-babc4b722886 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] [instance: 49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:32.907790 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-669084b0-dce0-4ed2-a1ab-babc4b722886 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:32.908284 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-669084b0-dce0-4ed2-a1ab-babc4b722886 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:32.908556 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-669084b0-dce0-4ed2-a1ab-babc4b722886 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:32.909261 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-669084b0-dce0-4ed2-a1ab-babc4b722886 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:32.909743 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-669084b0-dce0-4ed2-a1ab-babc4b722886 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:32.910160 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-669084b0-dce0-4ed2-a1ab-babc4b722886 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:33.077077 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-669084b0-dce0-4ed2-a1ab-babc4b722886 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931dcabba0214e3daa878f31cd1706cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f956d4d27437c830871f6634a3018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:33.092950 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-669084b0-dce0-4ed2-a1ab-babc4b722886 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] 10.222.0.61 "GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8" status: 200 len: 1592 microversion: 2.1 time: 0.195869 Aug 27 02:24:33.093985 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 290/585] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:32 2022] GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8 => generated 1592 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:24:33.102873 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [req-6d8f5b4e-c16f-488f-96ac-116b827c61ac req-9b6ec37d-f215-4b26-b0cb-2fac23454ffc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e641be3-227d-43c1-aa50-ecf2b89529c9", "tag": "6b558a7b-08bb-43cd-9d97-fbc18a195403"}]} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:24:33.113438 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-940a3108-ee5e-4594-8d06-968940962b52 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fbea2c71674b239e6d8fba6518e962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d9d02db5c49fda33321f2914a7f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:33.115765 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-6d8f5b4e-c16f-488f-96ac-116b827c61ac req-9b6ec37d-f215-4b26-b0cb-2fac23454ffc service nova] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:33.118186 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-6d8f5b4e-c16f-488f-96ac-116b827c61ac req-9b6ec37d-f215-4b26-b0cb-2fac23454ffc service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:33.118674 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-6d8f5b4e-c16f-488f-96ac-116b827c61ac req-9b6ec37d-f215-4b26-b0cb-2fac23454ffc service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:33.153888 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.compute.server_external_events [req-6d8f5b4e-c16f-488f-96ac-116b827c61ac req-9b6ec37d-f215-4b26-b0cb-2fac23454ffc service nova] Creating event network-changed:6b558a7b-08bb-43cd-9d97-fbc18a195403 for instance 4e641be3-227d-43c1-aa50-ecf2b89529c9 on hv-cinder-84630 Aug 27 02:24:33.160983 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [req-6d8f5b4e-c16f-488f-96ac-116b827c61ac req-9b6ec37d-f215-4b26-b0cb-2fac23454ffc service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065536 Aug 27 02:24:33.173597 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-940a3108-ee5e-4594-8d06-968940962b52 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1" status: 200 len: 1651 microversion: 2.1 time: 0.498235 Aug 27 02:24:33.173896 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 291/586] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Aug 27 02:24:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:24:33.174807 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 296/587] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:32 2022] GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1 => generated 1651 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:24:33.179595 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-ffe1ed52-274a-4385-a354-2edb47f4f7da tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:33.180357 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-ffe1ed52-274a-4385-a354-2edb47f4f7da tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] [instance: 4e641be3-227d-43c1-aa50-ecf2b89529c9] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:33.192693 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ffe1ed52-274a-4385-a354-2edb47f4f7da tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:33.193532 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ffe1ed52-274a-4385-a354-2edb47f4f7da tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:33.194145 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ffe1ed52-274a-4385-a354-2edb47f4f7da tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:33.195134 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ffe1ed52-274a-4385-a354-2edb47f4f7da tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:33.197082 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ffe1ed52-274a-4385-a354-2edb47f4f7da tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:33.197865 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ffe1ed52-274a-4385-a354-2edb47f4f7da tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:33.198002 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-bf225777-e102-47df-9ac1-90a888753a29 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:24:33.207713 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-bf225777-e102-47df-9ac1-90a888753a29 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:33.208329 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-bf225777-e102-47df-9ac1-90a888753a29 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:33.209066 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-bf225777-e102-47df-9ac1-90a888753a29 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:33.248357 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-bf225777-e102-47df-9ac1-90a888753a29 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 4fedf0d1-cc1c-4947-b92e-dcb4454889d1] Going to try to start instance {{(pid=120782) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 27 02:24:33.324223 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-bf225777-e102-47df-9ac1-90a888753a29 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "POST /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1/action" status: 202 len: 0 microversion: 2.1 time: 0.132242 Aug 27 02:24:33.325471 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 297/588] 10.222.0.61 () {60 vars in 1278 bytes} [Sat Aug 27 02:24:33 2022] POST /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 02:24:33.343875 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-80e70eed-a204-4de1-8cb7-02e26ba889f7 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:33.349222 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-80e70eed-a204-4de1-8cb7-02e26ba889f7 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 4fedf0d1-cc1c-4947-b92e-dcb4454889d1] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:33.365824 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-80e70eed-a204-4de1-8cb7-02e26ba889f7 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:33.368935 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-80e70eed-a204-4de1-8cb7-02e26ba889f7 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:33.369379 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-80e70eed-a204-4de1-8cb7-02e26ba889f7 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:33.370178 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-80e70eed-a204-4de1-8cb7-02e26ba889f7 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:33.370641 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-80e70eed-a204-4de1-8cb7-02e26ba889f7 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:33.371075 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-80e70eed-a204-4de1-8cb7-02e26ba889f7 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:33.518838 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-ffe1ed52-274a-4385-a354-2edb47f4f7da tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f931e726872474dae2b7b6fbb0eb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7bf59244bc487b84c7dbf9aa7314d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:33.529602 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-ffe1ed52-274a-4385-a354-2edb47f4f7da tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] 10.222.0.61 "GET /compute/v2.1/servers/4e641be3-227d-43c1-aa50-ecf2b89529c9" status: 200 len: 1319 microversion: 2.1 time: 0.354332 Aug 27 02:24:33.530967 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 292/589] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:33 2022] GET /compute/v2.1/servers/4e641be3-227d-43c1-aa50-ecf2b89529c9 => generated 1319 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:24:33.542741 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-47b8506f-13c4-490d-8aee-b00bf5660b24 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:33.543896 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-47b8506f-13c4-490d-8aee-b00bf5660b24 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: 268d786c-398a-4305-85ac-545fa3b4370b] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:33.558294 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-47b8506f-13c4-490d-8aee-b00bf5660b24 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:33.559036 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-47b8506f-13c4-490d-8aee-b00bf5660b24 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:33.560030 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-47b8506f-13c4-490d-8aee-b00bf5660b24 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:33.561760 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-47b8506f-13c4-490d-8aee-b00bf5660b24 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:33.562677 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-47b8506f-13c4-490d-8aee-b00bf5660b24 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:33.573929 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-47b8506f-13c4-490d-8aee-b00bf5660b24 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:33.593568 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.wsgi [None req-47b8506f-13c4-490d-8aee-b00bf5660b24 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] HTTP exception thrown: Instance 268d786c-398a-4305-85ac-545fa3b4370b could not be found. Aug 27 02:24:33.595297 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-47b8506f-13c4-490d-8aee-b00bf5660b24 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Request method failure captured: Aug 27 02:24:33.595297 dv-cinder-846303-3-smb devstack@n-api.service[120783]: request: GET /compute/v2.1/servers/268d786c-398a-4305-85ac-545fa3b4370b HTTP/1.1 Aug 27 02:24:33.595297 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Accept: application/json Aug 27 02:24:33.595297 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Accept-Encoding: identity Aug 27 02:24:33.595297 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Connection: close Aug 27 02:24:33.595297 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Content-Length: 0 Aug 27 02:24:33.595297 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Content-Type: application/json Aug 27 02:24:33.595297 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Host: 10.222.0.61 Aug 27 02:24:33.595297 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Openstack-System-Scope: None Aug 27 02:24:33.595297 dv-cinder-846303-3-smb devstack@n-api.service[120783]: User-Agent: python-urllib3/1.26.11 Aug 27 02:24:33.595297 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Auth-Token: gAAAAABjCX-GZMxBoDm0UEKrtF9w1zn8zf5k_pRKs9w1w8QBRmamyePi9gdcvRwYzK044f89BKz1wZ6FALfNLv1C6uDnz_VZDZcPY_z2HcyDI5nmMGMvL5rG2v4zh3O1IrszVG_kNPPcMoviX7QaOQhXuRqD1X6DsEJwS6gyWrQ-SPSaYeWVQOw Aug 27 02:24:33.595297 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Domain-Id: None Aug 27 02:24:33.595297 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Domain-Name: None Aug 27 02:24:33.595297 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Identity-Status: Confirmed Aug 27 02:24:33.595297 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Is-Admin-Project: True Aug 27 02:24:33.595297 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Project-Domain-Id: default Aug 27 02:24:33.595297 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Project-Domain-Name: Default Aug 27 02:24:33.595297 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Project-Id: 8aa1c411b57d4e72885dac2b4f4dfe7a Aug 27 02:24:33.595297 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Project-Name: tempest-AttachVolumeNegativeTest-799378516 Aug 27 02:24:33.595297 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Role: member,reader Aug 27 02:24:33.595297 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Roles: member,reader Aug 27 02:24:33.597758 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/8aa1c411b57d4e72885dac2b4f4dfe7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_8aa1c411b57d4e72885dac2b4f4dfe7a", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8aa1c411b57d4e72885dac2b4f4dfe7a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8aa1c411b57d4e72885dac2b4f4dfe7a"}]}] Aug 27 02:24:33.597758 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Tenant: tempest-AttachVolumeNegativeTest-799378516 Aug 27 02:24:33.597758 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Tenant-Id: 8aa1c411b57d4e72885dac2b4f4dfe7a Aug 27 02:24:33.597758 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-799378516 Aug 27 02:24:33.597758 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User: tempest-AttachVolumeNegativeTest-799378516-project Aug 27 02:24:33.597758 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User-Domain-Id: default Aug 27 02:24:33.597758 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User-Domain-Name: Default Aug 27 02:24:33.597758 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User-Id: 4a6f819365574091ae344f14e47f487f Aug 27 02:24:33.597758 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User-Name: tempest-AttachVolumeNegativeTest-799378516-project Aug 27 02:24:33.597758 dv-cinder-846303-3-smb devstack@n-api.service[120783]: method: > Aug 27 02:24:33.597758 dv-cinder-846303-3-smb devstack@n-api.service[120783]: exception: Instance 268d786c-398a-4305-85ac-545fa3b4370b could not be found. Aug 27 02:24:33.597758 dv-cinder-846303-3-smb devstack@n-api.service[120783]: action_args: {'id': '268d786c-398a-4305-85ac-545fa3b4370b'} Aug 27 02:24:33.599176 dv-cinder-846303-3-smb devstack@n-api.service[120783]: {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:24:33.599176 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:24:33.599176 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:24:33.599176 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:24:33.599176 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:24:33.599176 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:24:33.599176 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:24:33.599176 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:24:33.599176 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:24:33.599176 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:24:33.599176 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 268d786c-398a-4305-85ac-545fa3b4370b could not be found. Aug 27 02:24:33.599176 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:24:33.599176 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:24:33.599176 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:24:33.599176 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:24:33.599176 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:24:33.599176 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:24:33.599176 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:24:33.599176 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:24:33.599176 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:24:33.601376 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:24:33.601376 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:24:33.601376 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:24:33.601376 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:24:33.601376 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:24:33.601376 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:24:33.601376 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:24:33.601376 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 268d786c-398a-4305-85ac-545fa3b4370b could not be found. Aug 27 02:24:33.601376 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:24:33.601376 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:24:33.601376 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:24:33.601376 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:24:33.601376 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:24:33.601376 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:24:33.601376 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:24:33.601376 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:24:33.601376 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 268d786c-398a-4305-85ac-545fa3b4370b could not be found. Aug 27 02:24:33.601376 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:24:33.607638 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-47b8506f-13c4-490d-8aee-b00bf5660b24 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Returning 404 to user: Instance 268d786c-398a-4305-85ac-545fa3b4370b could not be found. {{(pid=120783) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:24:33.607638 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-47b8506f-13c4-490d-8aee-b00bf5660b24 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/268d786c-398a-4305-85ac-545fa3b4370b" status: 404 len: 111 microversion: 2.1 time: 0.058505 Aug 27 02:24:33.607638 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 293/590] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:33 2022] GET /compute/v2.1/servers/268d786c-398a-4305-85ac-545fa3b4370b => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:24:33.611594 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-07bf82c1-a984-4a55-845c-a9c2d747a7d5 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '.version_select at 0x7fd808730790>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:33.648949 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-07bf82c1-a984-4a55-845c-a9c2d747a7d5 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1736570259" status: 202 len: 0 microversion: 2.1 time: 0.045990 Aug 27 02:24:33.650033 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 294/591] 10.222.0.61 () {58 vars in 1221 bytes} [Sat Aug 27 02:24:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1736570259 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 02:24:33.714305 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-49943aa3-e62e-4ac4-9670-3371111fc461 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:33.715945 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-49943aa3-e62e-4ac4-9670-3371111fc461 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 1b9390be-aab0-4240-83d9-0f815f094605] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:33.729660 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-49943aa3-e62e-4ac4-9670-3371111fc461 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:33.730407 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-49943aa3-e62e-4ac4-9670-3371111fc461 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:33.731082 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-49943aa3-e62e-4ac4-9670-3371111fc461 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:33.732216 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-49943aa3-e62e-4ac4-9670-3371111fc461 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:33.733216 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-49943aa3-e62e-4ac4-9670-3371111fc461 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:33.734734 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-49943aa3-e62e-4ac4-9670-3371111fc461 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:33.810568 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-80e70eed-a204-4de1-8cb7-02e26ba889f7 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fbea2c71674b239e6d8fba6518e962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d9d02db5c49fda33321f2914a7f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:33.824595 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-80e70eed-a204-4de1-8cb7-02e26ba889f7 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1" status: 200 len: 1660 microversion: 2.1 time: 0.493387 Aug 27 02:24:33.826407 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 298/592] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:33 2022] GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1 => generated 1660 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:24:33.949934 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell0:SELECT=2 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:24:34.424595 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-49943aa3-e62e-4ac4-9670-3371111fc461 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:34.434444 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-49943aa3-e62e-4ac4-9670-3371111fc461 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605" status: 200 len: 1734 microversion: 2.1 time: 0.728395 Aug 27 02:24:34.435481 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 295/593] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:33 2022] GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605 => generated 1734 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:24:34.555720 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-c04ff7fa-89ce-49af-b753-2b83a1e237ef tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:34.556799 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-c04ff7fa-89ce-49af-b753-2b83a1e237ef tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] [instance: 4e641be3-227d-43c1-aa50-ecf2b89529c9] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:34.565727 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c04ff7fa-89ce-49af-b753-2b83a1e237ef tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:34.566521 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c04ff7fa-89ce-49af-b753-2b83a1e237ef tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:34.567117 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c04ff7fa-89ce-49af-b753-2b83a1e237ef tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:34.568169 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c04ff7fa-89ce-49af-b753-2b83a1e237ef tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:34.568848 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c04ff7fa-89ce-49af-b753-2b83a1e237ef tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:34.569459 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c04ff7fa-89ce-49af-b753-2b83a1e237ef tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:34.853644 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-2c21e015-412b-42f0-af80-73c274220224 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:34.855067 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-2c21e015-412b-42f0-af80-73c274220224 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 4fedf0d1-cc1c-4947-b92e-dcb4454889d1] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:34.866534 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2c21e015-412b-42f0-af80-73c274220224 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:34.868234 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2c21e015-412b-42f0-af80-73c274220224 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:34.869430 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2c21e015-412b-42f0-af80-73c274220224 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:34.870907 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2c21e015-412b-42f0-af80-73c274220224 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:34.871945 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2c21e015-412b-42f0-af80-73c274220224 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:34.874063 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2c21e015-412b-42f0-af80-73c274220224 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:34.884668 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-c04ff7fa-89ce-49af-b753-2b83a1e237ef tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f931e726872474dae2b7b6fbb0eb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7bf59244bc487b84c7dbf9aa7314d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:34.910197 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-c04ff7fa-89ce-49af-b753-2b83a1e237ef tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] 10.222.0.61 "GET /compute/v2.1/servers/4e641be3-227d-43c1-aa50-ecf2b89529c9" status: 200 len: 1319 microversion: 2.1 time: 0.361363 Aug 27 02:24:34.922449 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 299/594] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:34 2022] GET /compute/v2.1/servers/4e641be3-227d-43c1-aa50-ecf2b89529c9 => generated 1319 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:24:35.194311 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [req-bef0c461-e130-4126-a29e-5b20e2a80dea req-b3d55da5-2ae6-4967-b118-046a82b3c748 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fb59350-4f09-4e20-bddb-ffc9a65897b3", "tag": "b6386749-9042-42f7-933e-fe24b60012ef"}]} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:24:35.212532 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-bef0c461-e130-4126-a29e-5b20e2a80dea req-b3d55da5-2ae6-4967-b118-046a82b3c748 service nova] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:35.213781 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-bef0c461-e130-4126-a29e-5b20e2a80dea req-b3d55da5-2ae6-4967-b118-046a82b3c748 service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:35.214552 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-bef0c461-e130-4126-a29e-5b20e2a80dea req-b3d55da5-2ae6-4967-b118-046a82b3c748 service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:35.237914 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.compute.server_external_events [req-bef0c461-e130-4126-a29e-5b20e2a80dea req-b3d55da5-2ae6-4967-b118-046a82b3c748 service nova] Creating event network-changed:b6386749-9042-42f7-933e-fe24b60012ef for instance 9fb59350-4f09-4e20-bddb-ffc9a65897b3 on hv-cinder-84630 Aug 27 02:24:35.247479 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [req-bef0c461-e130-4126-a29e-5b20e2a80dea req-b3d55da5-2ae6-4967-b118-046a82b3c748 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059991 Aug 27 02:24:35.249490 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 300/595] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Aug 27 02:24:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:24:35.275045 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-2c21e015-412b-42f0-af80-73c274220224 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fbea2c71674b239e6d8fba6518e962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d9d02db5c49fda33321f2914a7f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:35.293955 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-2c21e015-412b-42f0-af80-73c274220224 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1" status: 200 len: 1660 microversion: 2.1 time: 0.448783 Aug 27 02:24:35.310077 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 296/596] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:34 2022] GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1 => generated 1660 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:24:35.475918 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-6ea16145-54cf-4dae-8acb-5934373d197c tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:35.477444 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-6ea16145-54cf-4dae-8acb-5934373d197c tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 1b9390be-aab0-4240-83d9-0f815f094605] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:35.489986 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6ea16145-54cf-4dae-8acb-5934373d197c tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:35.491746 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6ea16145-54cf-4dae-8acb-5934373d197c tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:35.492819 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6ea16145-54cf-4dae-8acb-5934373d197c tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:35.494323 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6ea16145-54cf-4dae-8acb-5934373d197c tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:35.495355 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6ea16145-54cf-4dae-8acb-5934373d197c tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:35.496291 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6ea16145-54cf-4dae-8acb-5934373d197c tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:35.969171 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-99045aaf-65b4-4f71-83a8-13b1c7d0df7d tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:35.971474 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-99045aaf-65b4-4f71-83a8-13b1c7d0df7d tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] [instance: 4e641be3-227d-43c1-aa50-ecf2b89529c9] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:35.993867 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-99045aaf-65b4-4f71-83a8-13b1c7d0df7d tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:35.998708 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-99045aaf-65b4-4f71-83a8-13b1c7d0df7d tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:35.999947 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-99045aaf-65b4-4f71-83a8-13b1c7d0df7d tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:36.001892 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-99045aaf-65b4-4f71-83a8-13b1c7d0df7d tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:36.016412 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-99045aaf-65b4-4f71-83a8-13b1c7d0df7d tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:36.018682 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-99045aaf-65b4-4f71-83a8-13b1c7d0df7d tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:36.182327 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-6ea16145-54cf-4dae-8acb-5934373d197c tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:36.203827 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-6ea16145-54cf-4dae-8acb-5934373d197c tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605" status: 200 len: 1734 microversion: 2.1 time: 0.735904 Aug 27 02:24:36.238135 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 301/597] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:35 2022] GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605 => generated 1734 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:24:36.247266 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-6f28615b-2338-453d-ac6c-4c333e9e7283 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Action: 'create', calling method: .version_select at 0x7fd8083d6430>, body: {"keypair": {"name": "tempest-keypair-1006882662", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD6hSydqHHhatqgVQPWpptV2hI8FFoRuBQlqbduct1gH+YIRMcKdLs3orj4YImuN0vw28FvPZMxc4OMmfZJMP4hWZwKT2fSyb21O53iftppWtWfVtdY6TbLIoCuUHAkhzw=="}} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:24:36.298841 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.quota [None req-6f28615b-2338-453d-ac6c-4c333e9e7283 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Getting quotas for project 8aa1c411b57d4e72885dac2b4f4dfe7a. Resources: {'key_pairs'} {{(pid=120782) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:24:36.330431 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.quota [None req-6f28615b-2338-453d-ac6c-4c333e9e7283 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Getting quotas for user 4a6f819365574091ae344f14e47f487f and project 8aa1c411b57d4e72885dac2b4f4dfe7a. Resources: {'key_pairs'} {{(pid=120782) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:24:36.402155 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-6f28615b-2338-453d-ac6c-4c333e9e7283 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.160369 Aug 27 02:24:36.416739 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 302/598] 10.222.0.61 () {60 vars in 1159 bytes} [Sat Aug 27 02:24:36 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:24:36.430290 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-e43d2524-374f-44f4-a848-1e2e8fc472de tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:36.436902 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-e43d2524-374f-44f4-a848-1e2e8fc472de tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 4fedf0d1-cc1c-4947-b92e-dcb4454889d1] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:36.452875 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e43d2524-374f-44f4-a848-1e2e8fc472de tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:36.453806 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e43d2524-374f-44f4-a848-1e2e8fc472de tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:36.454678 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e43d2524-374f-44f4-a848-1e2e8fc472de tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:36.456416 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e43d2524-374f-44f4-a848-1e2e8fc472de tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:36.458007 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e43d2524-374f-44f4-a848-1e2e8fc472de tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:36.458886 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e43d2524-374f-44f4-a848-1e2e8fc472de tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:37.118367 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-e43d2524-374f-44f4-a848-1e2e8fc472de tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fbea2c71674b239e6d8fba6518e962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d9d02db5c49fda33321f2914a7f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:37.153762 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-e43d2524-374f-44f4-a848-1e2e8fc472de tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1" status: 200 len: 1660 microversion: 2.1 time: 0.734656 Aug 27 02:24:37.154859 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 303/599] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:36 2022] GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1 => generated 1660 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:24:37.261328 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-c1b93a5e-0594-4a3b-884a-450e6124b495 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:37.262997 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-c1b93a5e-0594-4a3b-884a-450e6124b495 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 1b9390be-aab0-4240-83d9-0f815f094605] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:37.278301 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c1b93a5e-0594-4a3b-884a-450e6124b495 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:37.280138 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c1b93a5e-0594-4a3b-884a-450e6124b495 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:37.281039 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c1b93a5e-0594-4a3b-884a-450e6124b495 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:37.282741 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c1b93a5e-0594-4a3b-884a-450e6124b495 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:37.286483 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c1b93a5e-0594-4a3b-884a-450e6124b495 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:37.287425 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c1b93a5e-0594-4a3b-884a-450e6124b495 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:37.297661 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-99045aaf-65b4-4f71-83a8-13b1c7d0df7d tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f931e726872474dae2b7b6fbb0eb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7bf59244bc487b84c7dbf9aa7314d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:37.313459 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-99045aaf-65b4-4f71-83a8-13b1c7d0df7d tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] 10.222.0.61 "GET /compute/v2.1/servers/4e641be3-227d-43c1-aa50-ecf2b89529c9" status: 200 len: 1319 microversion: 2.1 time: 1.352308 Aug 27 02:24:37.320315 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 297/600] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:35 2022] GET /compute/v2.1/servers/4e641be3-227d-43c1-aa50-ecf2b89529c9 => generated 1319 bytes in 1356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:24:37.693562 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-c1b93a5e-0594-4a3b-884a-450e6124b495 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:37.707695 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-c1b93a5e-0594-4a3b-884a-450e6124b495 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605" status: 200 len: 1734 microversion: 2.1 time: 0.455758 Aug 27 02:24:37.708422 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 304/601] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:37 2022] GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605 => generated 1734 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:24:38.183187 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-ab2e0751-94fb-4dc3-b931-7721d58322ab tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:38.184696 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-ab2e0751-94fb-4dc3-b931-7721d58322ab tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 4fedf0d1-cc1c-4947-b92e-dcb4454889d1] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:38.205092 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ab2e0751-94fb-4dc3-b931-7721d58322ab tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:38.206939 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ab2e0751-94fb-4dc3-b931-7721d58322ab tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:38.207721 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ab2e0751-94fb-4dc3-b931-7721d58322ab tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:38.209165 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ab2e0751-94fb-4dc3-b931-7721d58322ab tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:38.210164 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ab2e0751-94fb-4dc3-b931-7721d58322ab tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:38.210989 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ab2e0751-94fb-4dc3-b931-7721d58322ab tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:38.344452 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-e092c213-598a-4ebc-821c-ce0263c66ce4 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:38.346453 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-e092c213-598a-4ebc-821c-ce0263c66ce4 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] [instance: 4e641be3-227d-43c1-aa50-ecf2b89529c9] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:38.357675 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e092c213-598a-4ebc-821c-ce0263c66ce4 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:38.358826 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e092c213-598a-4ebc-821c-ce0263c66ce4 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:38.359851 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e092c213-598a-4ebc-821c-ce0263c66ce4 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:38.361505 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e092c213-598a-4ebc-821c-ce0263c66ce4 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:38.362498 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e092c213-598a-4ebc-821c-ce0263c66ce4 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:38.363418 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e092c213-598a-4ebc-821c-ce0263c66ce4 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:38.620181 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-e092c213-598a-4ebc-821c-ce0263c66ce4 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f931e726872474dae2b7b6fbb0eb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7bf59244bc487b84c7dbf9aa7314d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:38.631321 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-ab2e0751-94fb-4dc3-b931-7721d58322ab tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fbea2c71674b239e6d8fba6518e962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d9d02db5c49fda33321f2914a7f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:38.641289 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-e092c213-598a-4ebc-821c-ce0263c66ce4 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] 10.222.0.61 "GET /compute/v2.1/servers/4e641be3-227d-43c1-aa50-ecf2b89529c9" status: 200 len: 1319 microversion: 2.1 time: 0.303988 Aug 27 02:24:38.646016 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-ab2e0751-94fb-4dc3-b931-7721d58322ab tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1" status: 200 len: 1664 microversion: 2.1 time: 0.473410 Aug 27 02:24:38.661862 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 305/602] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:38 2022] GET /compute/v2.1/servers/4e641be3-227d-43c1-aa50-ecf2b89529c9 => generated 1319 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:24:38.662106 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 298/603] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:38 2022] GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1 => generated 1664 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:24:38.663469 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [req-32d8bf95-b50c-4c2d-bb4e-eda39d00bc91 req-02cefc71-b96b-4527-b9c9-b2cb0abdf6d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8", "tag": "d60d4774-8401-4c3b-b403-1555799f9a3f"}]} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:24:38.682533 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-32d8bf95-b50c-4c2d-bb4e-eda39d00bc91 req-02cefc71-b96b-4527-b9c9-b2cb0abdf6d8 service nova] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:38.683584 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-32d8bf95-b50c-4c2d-bb4e-eda39d00bc91 req-02cefc71-b96b-4527-b9c9-b2cb0abdf6d8 service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:38.684303 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-32d8bf95-b50c-4c2d-bb4e-eda39d00bc91 req-02cefc71-b96b-4527-b9c9-b2cb0abdf6d8 service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:38.722124 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.compute.server_external_events [req-32d8bf95-b50c-4c2d-bb4e-eda39d00bc91 req-02cefc71-b96b-4527-b9c9-b2cb0abdf6d8 service nova] Creating event network-changed:d60d4774-8401-4c3b-b403-1555799f9a3f for instance 49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8 on hv-cinder-84630 Aug 27 02:24:38.732378 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-e24d5700-6fb9-43f0-9876-9bee3cd02f00 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:38.732996 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-e24d5700-6fb9-43f0-9876-9bee3cd02f00 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 1b9390be-aab0-4240-83d9-0f815f094605] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:38.736698 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [req-32d8bf95-b50c-4c2d-bb4e-eda39d00bc91 req-02cefc71-b96b-4527-b9c9-b2cb0abdf6d8 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086216 Aug 27 02:24:38.737992 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 306/604] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Aug 27 02:24:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:24:38.746871 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e24d5700-6fb9-43f0-9876-9bee3cd02f00 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:38.747377 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e24d5700-6fb9-43f0-9876-9bee3cd02f00 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:38.747815 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e24d5700-6fb9-43f0-9876-9bee3cd02f00 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:38.748539 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e24d5700-6fb9-43f0-9876-9bee3cd02f00 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:38.748996 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e24d5700-6fb9-43f0-9876-9bee3cd02f00 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:38.749446 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e24d5700-6fb9-43f0-9876-9bee3cd02f00 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:38.964396 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [req-d9d02bca-5429-4268-92cd-5a9305a70908 req-1ec8af7f-c2b7-44b3-98a5-6a750de1476d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e641be3-227d-43c1-aa50-ecf2b89529c9", "name": "network-vif-plugged", "status": "completed", "tag": "6b558a7b-08bb-43cd-9d97-fbc18a195403"}]} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:24:38.974626 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-d9d02bca-5429-4268-92cd-5a9305a70908 req-1ec8af7f-c2b7-44b3-98a5-6a750de1476d service nova] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:38.975460 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-d9d02bca-5429-4268-92cd-5a9305a70908 req-1ec8af7f-c2b7-44b3-98a5-6a750de1476d service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:38.976106 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-d9d02bca-5429-4268-92cd-5a9305a70908 req-1ec8af7f-c2b7-44b3-98a5-6a750de1476d service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:38.993466 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.compute.server_external_events [req-d9d02bca-5429-4268-92cd-5a9305a70908 req-1ec8af7f-c2b7-44b3-98a5-6a750de1476d service nova] Creating event network-vif-plugged:6b558a7b-08bb-43cd-9d97-fbc18a195403 for instance 4e641be3-227d-43c1-aa50-ecf2b89529c9 on hv-cinder-84630 Aug 27 02:24:38.999836 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [req-d9d02bca-5429-4268-92cd-5a9305a70908 req-1ec8af7f-c2b7-44b3-98a5-6a750de1476d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039371 Aug 27 02:24:39.001507 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 307/605] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Aug 27 02:24:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:24:39.190869 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-e24d5700-6fb9-43f0-9876-9bee3cd02f00 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:39.204827 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-e24d5700-6fb9-43f0-9876-9bee3cd02f00 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605" status: 200 len: 1734 microversion: 2.1 time: 0.476557 Aug 27 02:24:39.206080 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 299/606] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:38 2022] GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605 => generated 1734 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:24:39.562298 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-ce587dfd-becb-491d-ad65-925019b19974 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1677901444", "imageRef": "7d45cdd6-750f-40c7-9475-f7bf12fcb204", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0a6b16e1-c045-4fdd-a4f5-57e1f8fdda65"}], "security_groups": [{"name": "tempest-securitygroup--1585587749"}], "key_name": "tempest-keypair-1006882662", "user_data": "}} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:24:39.670238 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-3e666f20-4b5f-4fc9-a493-4cec855266da tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:39.670970 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-3e666f20-4b5f-4fc9-a493-4cec855266da tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] [instance: 4e641be3-227d-43c1-aa50-ecf2b89529c9] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:39.678869 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3e666f20-4b5f-4fc9-a493-4cec855266da tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:39.679473 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3e666f20-4b5f-4fc9-a493-4cec855266da tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:39.680071 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3e666f20-4b5f-4fc9-a493-4cec855266da tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:39.680888 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3e666f20-4b5f-4fc9-a493-4cec855266da tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:39.681589 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3e666f20-4b5f-4fc9-a493-4cec855266da tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:39.682251 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3e666f20-4b5f-4fc9-a493-4cec855266da tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:39.772091 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.network.neutron [None req-ce587dfd-becb-491d-ad65-925019b19974 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] validate_networks() for [('0a6b16e1-c045-4fdd-a4f5-57e1f8fdda65', None, None, None, None, None)] {{(pid=120782) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:24:39.927732 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-3e666f20-4b5f-4fc9-a493-4cec855266da tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f931e726872474dae2b7b6fbb0eb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7bf59244bc487b84c7dbf9aa7314d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:39.944608 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-3e666f20-4b5f-4fc9-a493-4cec855266da tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] 10.222.0.61 "GET /compute/v2.1/servers/4e641be3-227d-43c1-aa50-ecf2b89529c9" status: 200 len: 1319 microversion: 2.1 time: 0.276982 Aug 27 02:24:39.946195 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 300/607] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:39 2022] GET /compute/v2.1/servers/4e641be3-227d-43c1-aa50-ecf2b89529c9 => generated 1319 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:24:40.233839 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-d8c482c5-5c6c-4bf8-8d94-53700f3dda23 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:40.235455 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-d8c482c5-5c6c-4bf8-8d94-53700f3dda23 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 1b9390be-aab0-4240-83d9-0f815f094605] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:40.250358 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d8c482c5-5c6c-4bf8-8d94-53700f3dda23 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:40.250970 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d8c482c5-5c6c-4bf8-8d94-53700f3dda23 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:40.251416 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d8c482c5-5c6c-4bf8-8d94-53700f3dda23 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:40.252159 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d8c482c5-5c6c-4bf8-8d94-53700f3dda23 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:40.252606 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d8c482c5-5c6c-4bf8-8d94-53700f3dda23 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:40.256457 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d8c482c5-5c6c-4bf8-8d94-53700f3dda23 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:40.354774 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-ce587dfd-becb-491d-ad65-925019b19974 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Flavor limits 0:0:0 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:24:40.355370 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-ce587dfd-becb-491d-ad65-925019b19974 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Image limits 0:0:0 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:24:40.356049 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-ce587dfd-becb-491d-ad65-925019b19974 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Flavor pref 0:0:0 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:24:40.356969 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-ce587dfd-becb-491d-ad65-925019b19974 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Image pref 0:0:0 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:24:40.357554 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-ce587dfd-becb-491d-ad65-925019b19974 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:24:40.368461 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ce587dfd-becb-491d-ad65-925019b19974 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:40.369780 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ce587dfd-becb-491d-ad65-925019b19974 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:40.370464 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ce587dfd-becb-491d-ad65-925019b19974 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:40.371693 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ce587dfd-becb-491d-ad65-925019b19974 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:40.372180 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ce587dfd-becb-491d-ad65-925019b19974 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:40.372610 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ce587dfd-becb-491d-ad65-925019b19974 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:40.396948 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.quota [None req-ce587dfd-becb-491d-ad65-925019b19974 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Getting quotas for project 8aa1c411b57d4e72885dac2b4f4dfe7a. Resources: {'instances', 'ram', 'cores'} {{(pid=120782) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:24:40.402875 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.quota [None req-ce587dfd-becb-491d-ad65-925019b19974 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Getting quotas for user 4a6f819365574091ae344f14e47f487f and project 8aa1c411b57d4e72885dac2b4f4dfe7a. Resources: {'instances', 'ram', 'cores'} {{(pid=120782) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:24:40.416495 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-d8c482c5-5c6c-4bf8-8d94-53700f3dda23 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:40.417364 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-ce587dfd-becb-491d-ad65-925019b19974 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Going to run 1 instances... {{(pid=120782) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:24:40.420578 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-ce587dfd-becb-491d-ad65-925019b19974 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: 77c3697a-5b72-4f66-9ba0-0fba67484286] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7d45cdd6-750f-40c7-9475-f7bf12fcb204',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120782) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:24:40.430650 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-d8c482c5-5c6c-4bf8-8d94-53700f3dda23 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605" status: 200 len: 1734 microversion: 2.1 time: 0.202831 Aug 27 02:24:40.431851 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 301/608] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:40 2022] GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605 => generated 1734 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:24:40.482332 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-ce587dfd-becb-491d-ad65-925019b19974 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.926390 Aug 27 02:24:40.494796 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 308/609] 10.222.0.61 () {60 vars in 1147 bytes} [Sat Aug 27 02:24:39 2022] POST /compute/v2.1/servers => generated 402 bytes in 928 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:24:40.504754 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-f80a489c-6989-43c1-99db-81419ee1fb39 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:40.505505 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-f80a489c-6989-43c1-99db-81419ee1fb39 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: 77c3697a-5b72-4f66-9ba0-0fba67484286] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:40.519788 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-cd561204-3463-48a6-b921-ecf9da50b615 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1609678071"}} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:24:40.520581 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-cd561204-3463-48a6-b921-ecf9da50b615 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] [instance: 49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:40.528223 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cd561204-3463-48a6-b921-ecf9da50b615 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:40.528716 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cd561204-3463-48a6-b921-ecf9da50b615 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:40.529315 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cd561204-3463-48a6-b921-ecf9da50b615 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:40.530101 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cd561204-3463-48a6-b921-ecf9da50b615 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:40.530716 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cd561204-3463-48a6-b921-ecf9da50b615 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:40.531140 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cd561204-3463-48a6-b921-ecf9da50b615 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:40.581753 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-f80a489c-6989-43c1-99db-81419ee1fb39 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6f819365574091ae344f14e47f487f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa1c411b57d4e72885dac2b4f4dfe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:40.590977 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-f80a489c-6989-43c1-99db-81419ee1fb39 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/77c3697a-5b72-4f66-9ba0-0fba67484286" status: 200 len: 1242 microversion: 2.1 time: 0.090616 Aug 27 02:24:40.597442 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 302/610] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:40 2022] GET /compute/v2.1/servers/77c3697a-5b72-4f66-9ba0-0fba67484286 => generated 1242 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:24:40.689938 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.network.security_group_api [None req-cd561204-3463-48a6-b921-ecf9da50b615 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Adding security group ca4833a0-5f44-4d56-8bcf-e04f514ce92b to port d60d4774-8401-4c3b-b403-1555799f9a3f Aug 27 02:24:40.970900 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-96916c23-fb49-4951-adbc-862f4e4a63b0 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:40.971502 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-96916c23-fb49-4951-adbc-862f4e4a63b0 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] [instance: 4e641be3-227d-43c1-aa50-ecf2b89529c9] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:40.978272 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-96916c23-fb49-4951-adbc-862f4e4a63b0 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:40.978759 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-96916c23-fb49-4951-adbc-862f4e4a63b0 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:40.979176 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-96916c23-fb49-4951-adbc-862f4e4a63b0 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:40.980063 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-96916c23-fb49-4951-adbc-862f4e4a63b0 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:40.980526 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-96916c23-fb49-4951-adbc-862f4e4a63b0 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:40.980931 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-96916c23-fb49-4951-adbc-862f4e4a63b0 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:41.101804 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-cd561204-3463-48a6-b921-ecf9da50b615 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] 10.222.0.61 "POST /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8/action" status: 202 len: 0 microversion: 2.1 time: 0.586571 Aug 27 02:24:41.102931 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 309/611] 10.222.0.61 () {60 vars in 1278 bytes} [Sat Aug 27 02:24:40 2022] POST /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8/action => generated 0 bytes in 589 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:24:41.112817 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [req-23b64c8c-677d-42a7-9573-964a563376a3 req-d46e3432-c2a4-4284-b123-11881173e83e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8", "tag": "d60d4774-8401-4c3b-b403-1555799f9a3f"}]} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:24:41.135681 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-23b64c8c-677d-42a7-9573-964a563376a3 req-d46e3432-c2a4-4284-b123-11881173e83e service nova] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:41.136281 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-23b64c8c-677d-42a7-9573-964a563376a3 req-d46e3432-c2a4-4284-b123-11881173e83e service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:41.137038 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-23b64c8c-677d-42a7-9573-964a563376a3 req-d46e3432-c2a4-4284-b123-11881173e83e service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:41.159101 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.compute.server_external_events [req-23b64c8c-677d-42a7-9573-964a563376a3 req-d46e3432-c2a4-4284-b123-11881173e83e service nova] Creating event network-changed:d60d4774-8401-4c3b-b403-1555799f9a3f for instance 49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8 on hv-cinder-84630 Aug 27 02:24:41.165379 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [req-23b64c8c-677d-42a7-9573-964a563376a3 req-d46e3432-c2a4-4284-b123-11881173e83e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059772 Aug 27 02:24:41.166610 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 310/612] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Aug 27 02:24:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:24:41.172827 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-1e2c4514-0384-465f-a4b6-2db9222757ea tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:41.173954 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-1e2c4514-0384-465f-a4b6-2db9222757ea tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] [instance: 49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:41.174215 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-96916c23-fb49-4951-adbc-862f4e4a63b0 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f931e726872474dae2b7b6fbb0eb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7bf59244bc487b84c7dbf9aa7314d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:41.182945 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1e2c4514-0384-465f-a4b6-2db9222757ea tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:41.183706 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1e2c4514-0384-465f-a4b6-2db9222757ea tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:41.184107 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-96916c23-fb49-4951-adbc-862f4e4a63b0 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] 10.222.0.61 "GET /compute/v2.1/servers/4e641be3-227d-43c1-aa50-ecf2b89529c9" status: 200 len: 1319 microversion: 2.1 time: 0.217069 Aug 27 02:24:41.184447 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1e2c4514-0384-465f-a4b6-2db9222757ea tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:41.185108 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 303/613] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:40 2022] GET /compute/v2.1/servers/4e641be3-227d-43c1-aa50-ecf2b89529c9 => generated 1319 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:24:41.197838 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1e2c4514-0384-465f-a4b6-2db9222757ea tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:41.197838 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1e2c4514-0384-465f-a4b6-2db9222757ea tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:41.197838 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1e2c4514-0384-465f-a4b6-2db9222757ea tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:41.385371 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-1e2c4514-0384-465f-a4b6-2db9222757ea tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931dcabba0214e3daa878f31cd1706cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f956d4d27437c830871f6634a3018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:41.401818 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-1e2c4514-0384-465f-a4b6-2db9222757ea tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] 10.222.0.61 "GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8" status: 200 len: 1758 microversion: 2.1 time: 0.233287 Aug 27 02:24:41.402865 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 311/614] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:41 2022] GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8 => generated 1758 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:24:41.459022 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-3a73a71e-bf27-4cf9-ac83-40c4aebaaa29 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:41.460128 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-3a73a71e-bf27-4cf9-ac83-40c4aebaaa29 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 1b9390be-aab0-4240-83d9-0f815f094605] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:41.472124 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3a73a71e-bf27-4cf9-ac83-40c4aebaaa29 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:41.473388 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3a73a71e-bf27-4cf9-ac83-40c4aebaaa29 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:41.474456 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3a73a71e-bf27-4cf9-ac83-40c4aebaaa29 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:41.475990 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3a73a71e-bf27-4cf9-ac83-40c4aebaaa29 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:41.477799 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3a73a71e-bf27-4cf9-ac83-40c4aebaaa29 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:41.479019 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3a73a71e-bf27-4cf9-ac83-40c4aebaaa29 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:41.612253 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-f65b5cab-3aaa-44fb-8794-5251d589dd6b tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:41.613360 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-f65b5cab-3aaa-44fb-8794-5251d589dd6b tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: 77c3697a-5b72-4f66-9ba0-0fba67484286] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:41.621914 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f65b5cab-3aaa-44fb-8794-5251d589dd6b tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:41.622968 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f65b5cab-3aaa-44fb-8794-5251d589dd6b tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:41.623643 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f65b5cab-3aaa-44fb-8794-5251d589dd6b tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:41.624602 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f65b5cab-3aaa-44fb-8794-5251d589dd6b tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:41.625295 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f65b5cab-3aaa-44fb-8794-5251d589dd6b tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:41.626526 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f65b5cab-3aaa-44fb-8794-5251d589dd6b tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:41.658409 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:24:41.721685 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-f65b5cab-3aaa-44fb-8794-5251d589dd6b tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6f819365574091ae344f14e47f487f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa1c411b57d4e72885dac2b4f4dfe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:41.735798 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-f65b5cab-3aaa-44fb-8794-5251d589dd6b tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/77c3697a-5b72-4f66-9ba0-0fba67484286" status: 200 len: 1246 microversion: 2.1 time: 0.125898 Aug 27 02:24:41.751163 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 312/615] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:41 2022] GET /compute/v2.1/servers/77c3697a-5b72-4f66-9ba0-0fba67484286 => generated 1246 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:24:41.804844 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-3a73a71e-bf27-4cf9-ac83-40c4aebaaa29 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:41.808392 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell1:SELECT=100 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:24:41.814952 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-3a73a71e-bf27-4cf9-ac83-40c4aebaaa29 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605" status: 200 len: 1734 microversion: 2.1 time: 0.365403 Aug 27 02:24:41.815522 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 304/616] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:41 2022] GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605 => generated 1734 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:24:42.207029 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-d6ec1c6c-4c0f-472e-9e38-21688a2a9963 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:42.208097 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-d6ec1c6c-4c0f-472e-9e38-21688a2a9963 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] [instance: 4e641be3-227d-43c1-aa50-ecf2b89529c9] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:42.217690 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d6ec1c6c-4c0f-472e-9e38-21688a2a9963 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:42.218632 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d6ec1c6c-4c0f-472e-9e38-21688a2a9963 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:42.219337 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d6ec1c6c-4c0f-472e-9e38-21688a2a9963 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:42.220614 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d6ec1c6c-4c0f-472e-9e38-21688a2a9963 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:42.221150 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d6ec1c6c-4c0f-472e-9e38-21688a2a9963 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:42.221721 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d6ec1c6c-4c0f-472e-9e38-21688a2a9963 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:42.384889 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-d6ec1c6c-4c0f-472e-9e38-21688a2a9963 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f931e726872474dae2b7b6fbb0eb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7bf59244bc487b84c7dbf9aa7314d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:42.394759 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-d6ec1c6c-4c0f-472e-9e38-21688a2a9963 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] 10.222.0.61 "GET /compute/v2.1/servers/4e641be3-227d-43c1-aa50-ecf2b89529c9" status: 200 len: 1507 microversion: 2.1 time: 0.192651 Aug 27 02:24:42.395566 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 313/617] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:42 2022] GET /compute/v2.1/servers/4e641be3-227d-43c1-aa50-ecf2b89529c9 => generated 1507 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:24:42.416704 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-c8825d8d-a89e-41c2-ae61-837908c69035 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "355d390d-2815-43dc-97ef-cb85c177b3f0", "device": "/dev/sdb"}} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:24:42.419238 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-c8825d8d-a89e-41c2-ae61-837908c69035 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] [instance: 4e641be3-227d-43c1-aa50-ecf2b89529c9] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:42.426679 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c8825d8d-a89e-41c2-ae61-837908c69035 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:42.427137 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c8825d8d-a89e-41c2-ae61-837908c69035 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:42.427615 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c8825d8d-a89e-41c2-ae61-837908c69035 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:42.428359 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c8825d8d-a89e-41c2-ae61-837908c69035 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:42.428866 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c8825d8d-a89e-41c2-ae61-837908c69035 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:42.429331 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c8825d8d-a89e-41c2-ae61-837908c69035 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:42.765135 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-f2de5f15-9841-4bcd-92fa-747032bae2cc tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:42.766514 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-f2de5f15-9841-4bcd-92fa-747032bae2cc tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: 77c3697a-5b72-4f66-9ba0-0fba67484286] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:42.778461 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f2de5f15-9841-4bcd-92fa-747032bae2cc tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:42.779291 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f2de5f15-9841-4bcd-92fa-747032bae2cc tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:42.780069 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f2de5f15-9841-4bcd-92fa-747032bae2cc tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:42.781320 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f2de5f15-9841-4bcd-92fa-747032bae2cc tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:42.782185 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f2de5f15-9841-4bcd-92fa-747032bae2cc tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:42.782937 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f2de5f15-9841-4bcd-92fa-747032bae2cc tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:42.878270 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-f2de5f15-9841-4bcd-92fa-747032bae2cc tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6f819365574091ae344f14e47f487f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa1c411b57d4e72885dac2b4f4dfe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:42.886780 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-f2de5f15-9841-4bcd-92fa-747032bae2cc tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/77c3697a-5b72-4f66-9ba0-0fba67484286" status: 200 len: 1294 microversion: 2.1 time: 0.129745 Aug 27 02:24:42.887372 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 314/618] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:42 2022] GET /compute/v2.1/servers/77c3697a-5b72-4f66-9ba0-0fba67484286 => generated 1294 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:24:42.892550 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-62f19290-5528-4c89-82fb-13a65c9292f4 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:42.893183 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-62f19290-5528-4c89-82fb-13a65c9292f4 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 1b9390be-aab0-4240-83d9-0f815f094605] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:42.906488 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-62f19290-5528-4c89-82fb-13a65c9292f4 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:42.906963 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-62f19290-5528-4c89-82fb-13a65c9292f4 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:42.907402 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-62f19290-5528-4c89-82fb-13a65c9292f4 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:42.908122 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-62f19290-5528-4c89-82fb-13a65c9292f4 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:42.908572 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-62f19290-5528-4c89-82fb-13a65c9292f4 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:42.909006 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-62f19290-5528-4c89-82fb-13a65c9292f4 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:43.081358 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-62f19290-5528-4c89-82fb-13a65c9292f4 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:43.097928 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-62f19290-5528-4c89-82fb-13a65c9292f4 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605" status: 200 len: 1734 microversion: 2.1 time: 0.206709 Aug 27 02:24:43.098945 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 315/619] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:42 2022] GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605 => generated 1734 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:24:43.182421 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-c8825d8d-a89e-41c2-ae61-837908c69035 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] 10.222.0.61 "POST /compute/v2.1/servers/4e641be3-227d-43c1-aa50-ecf2b89529c9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.769511 Aug 27 02:24:43.183045 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 305/620] 10.222.0.61 () {60 vars in 1323 bytes} [Sat Aug 27 02:24:42 2022] POST /compute/v2.1/servers/4e641be3-227d-43c1-aa50-ecf2b89529c9/os-volume_attachments => generated 194 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:24:43.917302 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-ff4af834-44de-40b0-bff4-3eaf127a4251 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:43.918432 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-ff4af834-44de-40b0-bff4-3eaf127a4251 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: 77c3697a-5b72-4f66-9ba0-0fba67484286] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:43.930143 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ff4af834-44de-40b0-bff4-3eaf127a4251 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:43.931376 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ff4af834-44de-40b0-bff4-3eaf127a4251 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:43.932418 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ff4af834-44de-40b0-bff4-3eaf127a4251 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:43.933946 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ff4af834-44de-40b0-bff4-3eaf127a4251 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:43.934773 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ff4af834-44de-40b0-bff4-3eaf127a4251 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:43.935518 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ff4af834-44de-40b0-bff4-3eaf127a4251 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:44.121316 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-cde8233a-4be5-4498-9587-f2cc28d7da54 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:44.122049 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-cde8233a-4be5-4498-9587-f2cc28d7da54 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 1b9390be-aab0-4240-83d9-0f815f094605] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:44.128874 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-cde8233a-4be5-4498-9587-f2cc28d7da54 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:44.129427 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-cde8233a-4be5-4498-9587-f2cc28d7da54 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:44.129841 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-cde8233a-4be5-4498-9587-f2cc28d7da54 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:44.130597 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-cde8233a-4be5-4498-9587-f2cc28d7da54 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:44.131073 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-cde8233a-4be5-4498-9587-f2cc28d7da54 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:44.131477 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-cde8233a-4be5-4498-9587-f2cc28d7da54 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:44.141889 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-ff4af834-44de-40b0-bff4-3eaf127a4251 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6f819365574091ae344f14e47f487f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa1c411b57d4e72885dac2b4f4dfe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:44.154655 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-ff4af834-44de-40b0-bff4-3eaf127a4251 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/77c3697a-5b72-4f66-9ba0-0fba67484286" status: 200 len: 1368 microversion: 2.1 time: 0.247354 Aug 27 02:24:44.155823 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 316/621] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:43 2022] GET /compute/v2.1/servers/77c3697a-5b72-4f66-9ba0-0fba67484286 => generated 1368 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:24:44.343977 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-cde8233a-4be5-4498-9587-f2cc28d7da54 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:44.359648 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-cde8233a-4be5-4498-9587-f2cc28d7da54 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605" status: 200 len: 1734 microversion: 2.1 time: 0.242706 Aug 27 02:24:44.361210 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 306/622] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:44 2022] GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605 => generated 1734 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:24:45.191431 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-ad2dc74f-64bb-4f58-a9b1-222074f4d5c5 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:45.193763 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-ad2dc74f-64bb-4f58-a9b1-222074f4d5c5 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: 77c3697a-5b72-4f66-9ba0-0fba67484286] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:45.205987 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ad2dc74f-64bb-4f58-a9b1-222074f4d5c5 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:45.206708 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ad2dc74f-64bb-4f58-a9b1-222074f4d5c5 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:45.207544 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ad2dc74f-64bb-4f58-a9b1-222074f4d5c5 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:45.208627 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ad2dc74f-64bb-4f58-a9b1-222074f4d5c5 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:45.209723 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ad2dc74f-64bb-4f58-a9b1-222074f4d5c5 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:45.210727 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ad2dc74f-64bb-4f58-a9b1-222074f4d5c5 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:45.285327 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [req-939f13c2-5900-43de-a4ff-18f3791c3b9f req-9075272b-2d47-4f65-b302-bee2f937496c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77c3697a-5b72-4f66-9ba0-0fba67484286", "tag": "0920aabe-2380-40e3-a6ac-3334ec3130a5"}]} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:24:45.320582 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-939f13c2-5900-43de-a4ff-18f3791c3b9f req-9075272b-2d47-4f65-b302-bee2f937496c service nova] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:45.321385 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-939f13c2-5900-43de-a4ff-18f3791c3b9f req-9075272b-2d47-4f65-b302-bee2f937496c service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:45.332113 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-939f13c2-5900-43de-a4ff-18f3791c3b9f req-9075272b-2d47-4f65-b302-bee2f937496c service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:45.357563 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.compute.server_external_events [req-939f13c2-5900-43de-a4ff-18f3791c3b9f req-9075272b-2d47-4f65-b302-bee2f937496c service nova] Creating event network-changed:0920aabe-2380-40e3-a6ac-3334ec3130a5 for instance 77c3697a-5b72-4f66-9ba0-0fba67484286 on hv-cinder-84630 Aug 27 02:24:45.364507 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [req-939f13c2-5900-43de-a4ff-18f3791c3b9f req-9075272b-2d47-4f65-b302-bee2f937496c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084527 Aug 27 02:24:45.365800 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 307/623] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Aug 27 02:24:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:24:45.397526 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-4010c6a8-e2a2-4210-a857-63a85ddbbae7 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:45.398658 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-4010c6a8-e2a2-4210-a857-63a85ddbbae7 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 1b9390be-aab0-4240-83d9-0f815f094605] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:45.407542 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4010c6a8-e2a2-4210-a857-63a85ddbbae7 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:45.408166 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4010c6a8-e2a2-4210-a857-63a85ddbbae7 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:45.408761 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4010c6a8-e2a2-4210-a857-63a85ddbbae7 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:45.409712 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4010c6a8-e2a2-4210-a857-63a85ddbbae7 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:45.410264 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4010c6a8-e2a2-4210-a857-63a85ddbbae7 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:45.410792 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4010c6a8-e2a2-4210-a857-63a85ddbbae7 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:45.468487 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-ad2dc74f-64bb-4f58-a9b1-222074f4d5c5 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6f819365574091ae344f14e47f487f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa1c411b57d4e72885dac2b4f4dfe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:45.478977 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-ad2dc74f-64bb-4f58-a9b1-222074f4d5c5 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/77c3697a-5b72-4f66-9ba0-0fba67484286" status: 200 len: 1368 microversion: 2.1 time: 0.294990 Aug 27 02:24:45.480697 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 317/624] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:45 2022] GET /compute/v2.1/servers/77c3697a-5b72-4f66-9ba0-0fba67484286 => generated 1368 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:24:46.052866 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-4010c6a8-e2a2-4210-a857-63a85ddbbae7 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:46.061904 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-4010c6a8-e2a2-4210-a857-63a85ddbbae7 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605" status: 200 len: 1734 microversion: 2.1 time: 0.670399 Aug 27 02:24:46.065603 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 308/625] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:45 2022] GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605 => generated 1734 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:24:46.069063 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [req-bf6f1a64-6219-445d-9947-428a9d6133ae req-e6889a2b-ea83-40f4-b556-f91690e2b7cd admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "355d390d-2815-43dc-97ef-cb85c177b3f0", "create_info": {"type": "qcow2", "new_file": "volume-355d390d-2815-43dc-97ef-cb85c177b3f0.3be159a0-1be3-480e-8676-052d92099036.vhdx", "snapshot_id": "3be159a0-1be3-480e-8676-052d92099036"}}} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:24:46.072714 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-bf6f1a64-6219-445d-9947-428a9d6133ae req-e6889a2b-ea83-40f4-b556-f91690e2b7cd admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:46.073203 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-bf6f1a64-6219-445d-9947-428a9d6133ae req-e6889a2b-ea83-40f4-b556-f91690e2b7cd admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:46.073702 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-bf6f1a64-6219-445d-9947-428a9d6133ae req-e6889a2b-ea83-40f4-b556-f91690e2b7cd admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:46.082369 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-bf6f1a64-6219-445d-9947-428a9d6133ae req-e6889a2b-ea83-40f4-b556-f91690e2b7cd admin admin] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:46.082853 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-bf6f1a64-6219-445d-9947-428a9d6133ae req-e6889a2b-ea83-40f4-b556-f91690e2b7cd admin admin] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:46.083279 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-bf6f1a64-6219-445d-9947-428a9d6133ae req-e6889a2b-ea83-40f4-b556-f91690e2b7cd admin admin] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:46.097355 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [req-bf6f1a64-6219-445d-9947-428a9d6133ae req-e6889a2b-ea83-40f4-b556-f91690e2b7cd admin admin] 10.222.0.78 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.082919 Aug 27 02:24:46.098263 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 318/626] 10.222.0.78 () {64 vars in 1326 bytes} [Sat Aug 27 02:24:46 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 27 02:24:46.517585 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-078afe82-62ab-4b37-a5be-30e268c2051e tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:46.518226 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-078afe82-62ab-4b37-a5be-30e268c2051e tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: 77c3697a-5b72-4f66-9ba0-0fba67484286] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:46.524982 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-078afe82-62ab-4b37-a5be-30e268c2051e tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:46.525478 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-078afe82-62ab-4b37-a5be-30e268c2051e tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:46.525907 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-078afe82-62ab-4b37-a5be-30e268c2051e tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:46.526636 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-078afe82-62ab-4b37-a5be-30e268c2051e tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:46.527058 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-078afe82-62ab-4b37-a5be-30e268c2051e tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:46.527488 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-078afe82-62ab-4b37-a5be-30e268c2051e tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:46.670370 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-078afe82-62ab-4b37-a5be-30e268c2051e tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6f819365574091ae344f14e47f487f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa1c411b57d4e72885dac2b4f4dfe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:46.678539 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-078afe82-62ab-4b37-a5be-30e268c2051e tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/77c3697a-5b72-4f66-9ba0-0fba67484286" status: 200 len: 1368 microversion: 2.1 time: 0.165438 Aug 27 02:24:46.679103 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 309/627] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:46 2022] GET /compute/v2.1/servers/77c3697a-5b72-4f66-9ba0-0fba67484286 => generated 1368 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:24:47.097071 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-d02bbcc7-595d-416a-9b63-d928e6534f95 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:47.097777 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-d02bbcc7-595d-416a-9b63-d928e6534f95 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 1b9390be-aab0-4240-83d9-0f815f094605] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:47.104338 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d02bbcc7-595d-416a-9b63-d928e6534f95 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:47.104810 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d02bbcc7-595d-416a-9b63-d928e6534f95 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:47.105238 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d02bbcc7-595d-416a-9b63-d928e6534f95 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:47.105971 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d02bbcc7-595d-416a-9b63-d928e6534f95 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:47.106414 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d02bbcc7-595d-416a-9b63-d928e6534f95 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:47.106831 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d02bbcc7-595d-416a-9b63-d928e6534f95 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:47.256349 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-d02bbcc7-595d-416a-9b63-d928e6534f95 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:47.266017 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-d02bbcc7-595d-416a-9b63-d928e6534f95 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605" status: 200 len: 1734 microversion: 2.1 time: 0.173393 Aug 27 02:24:47.266596 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 319/628] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:47 2022] GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605 => generated 1734 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:24:47.699711 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-29131633-4b3c-49d0-a140-d8a8817c94e7 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:47.700335 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-29131633-4b3c-49d0-a140-d8a8817c94e7 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: 77c3697a-5b72-4f66-9ba0-0fba67484286] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:47.707535 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-29131633-4b3c-49d0-a140-d8a8817c94e7 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:47.708028 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-29131633-4b3c-49d0-a140-d8a8817c94e7 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:47.708456 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-29131633-4b3c-49d0-a140-d8a8817c94e7 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:47.709171 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-29131633-4b3c-49d0-a140-d8a8817c94e7 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:47.709648 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-29131633-4b3c-49d0-a140-d8a8817c94e7 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:47.710072 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-29131633-4b3c-49d0-a140-d8a8817c94e7 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:47.862975 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-29131633-4b3c-49d0-a140-d8a8817c94e7 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6f819365574091ae344f14e47f487f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa1c411b57d4e72885dac2b4f4dfe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:47.872050 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-29131633-4b3c-49d0-a140-d8a8817c94e7 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/77c3697a-5b72-4f66-9ba0-0fba67484286" status: 200 len: 1368 microversion: 2.1 time: 0.176149 Aug 27 02:24:47.872636 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 310/629] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:47 2022] GET /compute/v2.1/servers/77c3697a-5b72-4f66-9ba0-0fba67484286 => generated 1368 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:24:48.288575 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-db8e0d01-2d36-4fe7-81c2-1a161783477e tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:48.289549 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-db8e0d01-2d36-4fe7-81c2-1a161783477e tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 1b9390be-aab0-4240-83d9-0f815f094605] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:48.296910 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-db8e0d01-2d36-4fe7-81c2-1a161783477e tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:48.297426 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-db8e0d01-2d36-4fe7-81c2-1a161783477e tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:48.297891 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-db8e0d01-2d36-4fe7-81c2-1a161783477e tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:48.298608 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-db8e0d01-2d36-4fe7-81c2-1a161783477e tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:48.299081 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-db8e0d01-2d36-4fe7-81c2-1a161783477e tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:48.299510 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-db8e0d01-2d36-4fe7-81c2-1a161783477e tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:48.470109 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-db8e0d01-2d36-4fe7-81c2-1a161783477e tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:48.478857 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-db8e0d01-2d36-4fe7-81c2-1a161783477e tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605" status: 200 len: 1734 microversion: 2.1 time: 0.194332 Aug 27 02:24:48.479474 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 320/630] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:48 2022] GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605 => generated 1734 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:24:48.893099 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-f6d0cdb3-5eee-41d3-a9e2-6a4e13d71d0b tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:48.893805 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-f6d0cdb3-5eee-41d3-a9e2-6a4e13d71d0b tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: 77c3697a-5b72-4f66-9ba0-0fba67484286] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:48.900962 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f6d0cdb3-5eee-41d3-a9e2-6a4e13d71d0b tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:48.901486 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f6d0cdb3-5eee-41d3-a9e2-6a4e13d71d0b tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:48.901935 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f6d0cdb3-5eee-41d3-a9e2-6a4e13d71d0b tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:48.902634 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f6d0cdb3-5eee-41d3-a9e2-6a4e13d71d0b tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:48.903098 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f6d0cdb3-5eee-41d3-a9e2-6a4e13d71d0b tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:48.903535 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f6d0cdb3-5eee-41d3-a9e2-6a4e13d71d0b tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:49.042673 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-f6d0cdb3-5eee-41d3-a9e2-6a4e13d71d0b tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6f819365574091ae344f14e47f487f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa1c411b57d4e72885dac2b4f4dfe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:49.051301 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-f6d0cdb3-5eee-41d3-a9e2-6a4e13d71d0b tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/77c3697a-5b72-4f66-9ba0-0fba67484286" status: 200 len: 1368 microversion: 2.1 time: 0.162596 Aug 27 02:24:49.051902 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 311/631] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:48 2022] GET /compute/v2.1/servers/77c3697a-5b72-4f66-9ba0-0fba67484286 => generated 1368 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:24:49.501779 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-1ed55ba5-676e-4ee7-ae55-2d963398fc8c tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:49.502374 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-1ed55ba5-676e-4ee7-ae55-2d963398fc8c tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 1b9390be-aab0-4240-83d9-0f815f094605] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:49.504940 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:24:49.510556 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1ed55ba5-676e-4ee7-ae55-2d963398fc8c tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:49.511045 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1ed55ba5-676e-4ee7-ae55-2d963398fc8c tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:49.511465 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1ed55ba5-676e-4ee7-ae55-2d963398fc8c tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:49.512177 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1ed55ba5-676e-4ee7-ae55-2d963398fc8c tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:49.512617 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1ed55ba5-676e-4ee7-ae55-2d963398fc8c tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:49.513051 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1ed55ba5-676e-4ee7-ae55-2d963398fc8c tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:49.671865 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-1ed55ba5-676e-4ee7-ae55-2d963398fc8c tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:49.681070 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-1ed55ba5-676e-4ee7-ae55-2d963398fc8c tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605" status: 200 len: 1734 microversion: 2.1 time: 0.184460 Aug 27 02:24:49.694003 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 321/632] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:49 2022] GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605 => generated 1734 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:24:50.086383 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-772bfc85-940c-409c-ac44-313c33e888e2 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:50.087021 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-772bfc85-940c-409c-ac44-313c33e888e2 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: 77c3697a-5b72-4f66-9ba0-0fba67484286] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:50.094126 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-772bfc85-940c-409c-ac44-313c33e888e2 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:50.094622 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-772bfc85-940c-409c-ac44-313c33e888e2 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:50.095112 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-772bfc85-940c-409c-ac44-313c33e888e2 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:50.095824 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-772bfc85-940c-409c-ac44-313c33e888e2 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:50.096276 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-772bfc85-940c-409c-ac44-313c33e888e2 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:50.096695 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-772bfc85-940c-409c-ac44-313c33e888e2 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:50.258226 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-772bfc85-940c-409c-ac44-313c33e888e2 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6f819365574091ae344f14e47f487f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa1c411b57d4e72885dac2b4f4dfe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:50.268863 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-772bfc85-940c-409c-ac44-313c33e888e2 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/77c3697a-5b72-4f66-9ba0-0fba67484286" status: 200 len: 1368 microversion: 2.1 time: 0.186359 Aug 27 02:24:50.269565 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 312/633] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:50 2022] GET /compute/v2.1/servers/77c3697a-5b72-4f66-9ba0-0fba67484286 => generated 1368 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:24:50.706806 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-68fba45f-e534-433b-bf26-b1f483c1c570 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:50.707797 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-68fba45f-e534-433b-bf26-b1f483c1c570 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 1b9390be-aab0-4240-83d9-0f815f094605] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:50.711144 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell0:SELECT=10 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:24:50.720434 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-68fba45f-e534-433b-bf26-b1f483c1c570 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:50.721183 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-68fba45f-e534-433b-bf26-b1f483c1c570 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:50.722256 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-68fba45f-e534-433b-bf26-b1f483c1c570 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:50.723656 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-68fba45f-e534-433b-bf26-b1f483c1c570 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:50.724356 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-68fba45f-e534-433b-bf26-b1f483c1c570 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:50.724942 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-68fba45f-e534-433b-bf26-b1f483c1c570 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:50.894249 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-68fba45f-e534-433b-bf26-b1f483c1c570 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:50.904552 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-68fba45f-e534-433b-bf26-b1f483c1c570 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605" status: 200 len: 1734 microversion: 2.1 time: 0.204674 Aug 27 02:24:50.905162 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 322/634] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:50 2022] GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605 => generated 1734 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:24:51.294902 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-cfac4391-4ed0-47e3-a12a-d2023a4b4e81 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:51.296539 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-cfac4391-4ed0-47e3-a12a-d2023a4b4e81 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: 77c3697a-5b72-4f66-9ba0-0fba67484286] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:51.304510 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell0:SELECT=2 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:24:51.308931 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-cfac4391-4ed0-47e3-a12a-d2023a4b4e81 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:51.309726 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-cfac4391-4ed0-47e3-a12a-d2023a4b4e81 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:51.310403 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-cfac4391-4ed0-47e3-a12a-d2023a4b4e81 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:51.312197 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-cfac4391-4ed0-47e3-a12a-d2023a4b4e81 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:51.313108 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-cfac4391-4ed0-47e3-a12a-d2023a4b4e81 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:51.314003 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-cfac4391-4ed0-47e3-a12a-d2023a4b4e81 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:51.488202 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [req-ca10c191-84cb-48ce-82f9-276d4dcfe611 req-f09e97c8-2ea2-4a77-bb6d-c1be32f1963e admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "355d390d-2815-43dc-97ef-cb85c177b3f0", "create_info": {"type": "qcow2", "new_file": "volume-355d390d-2815-43dc-97ef-cb85c177b3f0.b3784b70-5225-4e83-af90-a82a6b715aca.vhdx", "snapshot_id": "b3784b70-5225-4e83-af90-a82a6b715aca"}}} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:24:51.496262 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-ca10c191-84cb-48ce-82f9-276d4dcfe611 req-f09e97c8-2ea2-4a77-bb6d-c1be32f1963e admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:51.496989 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-ca10c191-84cb-48ce-82f9-276d4dcfe611 req-f09e97c8-2ea2-4a77-bb6d-c1be32f1963e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:51.497803 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-ca10c191-84cb-48ce-82f9-276d4dcfe611 req-f09e97c8-2ea2-4a77-bb6d-c1be32f1963e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:51.514727 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-ca10c191-84cb-48ce-82f9-276d4dcfe611 req-f09e97c8-2ea2-4a77-bb6d-c1be32f1963e admin admin] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:51.516283 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-ca10c191-84cb-48ce-82f9-276d4dcfe611 req-f09e97c8-2ea2-4a77-bb6d-c1be32f1963e admin admin] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:51.517049 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-ca10c191-84cb-48ce-82f9-276d4dcfe611 req-f09e97c8-2ea2-4a77-bb6d-c1be32f1963e admin admin] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:51.545113 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [req-ca10c191-84cb-48ce-82f9-276d4dcfe611 req-f09e97c8-2ea2-4a77-bb6d-c1be32f1963e admin admin] 10.222.0.78 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.146011 Aug 27 02:24:51.546050 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 323/635] 10.222.0.78 () {64 vars in 1326 bytes} [Sat Aug 27 02:24:51 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 27 02:24:51.567211 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-cfac4391-4ed0-47e3-a12a-d2023a4b4e81 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6f819365574091ae344f14e47f487f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa1c411b57d4e72885dac2b4f4dfe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:51.575712 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-cfac4391-4ed0-47e3-a12a-d2023a4b4e81 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/77c3697a-5b72-4f66-9ba0-0fba67484286" status: 200 len: 1368 microversion: 2.1 time: 0.288217 Aug 27 02:24:51.576275 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 313/636] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:51 2022] GET /compute/v2.1/servers/77c3697a-5b72-4f66-9ba0-0fba67484286 => generated 1368 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:24:51.935221 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-f45419f9-4cf2-4ad9-8fdc-6526cac90e52 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:51.936069 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-f45419f9-4cf2-4ad9-8fdc-6526cac90e52 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 1b9390be-aab0-4240-83d9-0f815f094605] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:51.944022 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f45419f9-4cf2-4ad9-8fdc-6526cac90e52 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:51.944647 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f45419f9-4cf2-4ad9-8fdc-6526cac90e52 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:51.945227 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f45419f9-4cf2-4ad9-8fdc-6526cac90e52 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:51.946126 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f45419f9-4cf2-4ad9-8fdc-6526cac90e52 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:51.946672 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f45419f9-4cf2-4ad9-8fdc-6526cac90e52 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:51.947159 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f45419f9-4cf2-4ad9-8fdc-6526cac90e52 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:52.132081 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-f45419f9-4cf2-4ad9-8fdc-6526cac90e52 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:52.141229 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-f45419f9-4cf2-4ad9-8fdc-6526cac90e52 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605" status: 200 len: 1734 microversion: 2.1 time: 0.211105 Aug 27 02:24:52.141910 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 324/637] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:51 2022] GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605 => generated 1734 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:24:52.596922 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-cc6d9cea-3bf3-4b96-8137-7749c3945cbe tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:52.597983 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-cc6d9cea-3bf3-4b96-8137-7749c3945cbe tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: 77c3697a-5b72-4f66-9ba0-0fba67484286] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:52.606999 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-cc6d9cea-3bf3-4b96-8137-7749c3945cbe tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:52.607647 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-cc6d9cea-3bf3-4b96-8137-7749c3945cbe tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:52.608187 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-cc6d9cea-3bf3-4b96-8137-7749c3945cbe tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:52.609096 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-cc6d9cea-3bf3-4b96-8137-7749c3945cbe tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:52.609816 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-cc6d9cea-3bf3-4b96-8137-7749c3945cbe tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:52.610877 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-cc6d9cea-3bf3-4b96-8137-7749c3945cbe tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:52.692643 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [req-0272176a-b6d7-449c-aeef-17a9511645fd req-aa189f57-22dc-40f0-814b-f3865d24a2f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77c3697a-5b72-4f66-9ba0-0fba67484286", "name": "network-vif-plugged", "status": "completed", "tag": "0920aabe-2380-40e3-a6ac-3334ec3130a5"}]} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:24:52.708856 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-0272176a-b6d7-449c-aeef-17a9511645fd req-aa189f57-22dc-40f0-814b-f3865d24a2f5 service nova] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:52.709750 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-0272176a-b6d7-449c-aeef-17a9511645fd req-aa189f57-22dc-40f0-814b-f3865d24a2f5 service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:52.710686 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-0272176a-b6d7-449c-aeef-17a9511645fd req-aa189f57-22dc-40f0-814b-f3865d24a2f5 service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:52.736586 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.compute.server_external_events [req-0272176a-b6d7-449c-aeef-17a9511645fd req-aa189f57-22dc-40f0-814b-f3865d24a2f5 service nova] Creating event network-vif-plugged:0920aabe-2380-40e3-a6ac-3334ec3130a5 for instance 77c3697a-5b72-4f66-9ba0-0fba67484286 on hv-cinder-84630 Aug 27 02:24:52.744766 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [req-0272176a-b6d7-449c-aeef-17a9511645fd req-aa189f57-22dc-40f0-814b-f3865d24a2f5 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056956 Aug 27 02:24:52.746220 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 325/638] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Aug 27 02:24:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:24:52.801032 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-cc6d9cea-3bf3-4b96-8137-7749c3945cbe tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6f819365574091ae344f14e47f487f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa1c411b57d4e72885dac2b4f4dfe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:52.815358 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-cc6d9cea-3bf3-4b96-8137-7749c3945cbe tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/77c3697a-5b72-4f66-9ba0-0fba67484286" status: 200 len: 1368 microversion: 2.1 time: 0.222343 Aug 27 02:24:52.816344 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 314/639] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:52 2022] GET /compute/v2.1/servers/77c3697a-5b72-4f66-9ba0-0fba67484286 => generated 1368 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:24:53.165374 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-f4ab0ab7-766e-48aa-bbaa-1d74b8503f7b tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:53.166531 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-f4ab0ab7-766e-48aa-bbaa-1d74b8503f7b tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 1b9390be-aab0-4240-83d9-0f815f094605] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:53.174009 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f4ab0ab7-766e-48aa-bbaa-1d74b8503f7b tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:53.174700 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f4ab0ab7-766e-48aa-bbaa-1d74b8503f7b tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:53.175252 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f4ab0ab7-766e-48aa-bbaa-1d74b8503f7b tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:53.176177 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f4ab0ab7-766e-48aa-bbaa-1d74b8503f7b tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:53.176766 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f4ab0ab7-766e-48aa-bbaa-1d74b8503f7b tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:53.177329 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f4ab0ab7-766e-48aa-bbaa-1d74b8503f7b tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:53.324752 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-f4ab0ab7-766e-48aa-bbaa-1d74b8503f7b tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:53.335669 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-f4ab0ab7-766e-48aa-bbaa-1d74b8503f7b tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605" status: 200 len: 1734 microversion: 2.1 time: 0.175649 Aug 27 02:24:53.336424 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 326/640] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:53 2022] GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605 => generated 1734 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:24:53.850358 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-a6be2e62-729b-45d6-a9af-eb5f414a8410 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:53.850944 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-a6be2e62-729b-45d6-a9af-eb5f414a8410 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: 77c3697a-5b72-4f66-9ba0-0fba67484286] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:53.857954 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a6be2e62-729b-45d6-a9af-eb5f414a8410 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:53.858444 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a6be2e62-729b-45d6-a9af-eb5f414a8410 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:53.858878 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a6be2e62-729b-45d6-a9af-eb5f414a8410 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:53.859588 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a6be2e62-729b-45d6-a9af-eb5f414a8410 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:53.860037 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a6be2e62-729b-45d6-a9af-eb5f414a8410 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:53.860456 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a6be2e62-729b-45d6-a9af-eb5f414a8410 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:54.030301 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-a6be2e62-729b-45d6-a9af-eb5f414a8410 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6f819365574091ae344f14e47f487f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa1c411b57d4e72885dac2b4f4dfe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:54.048843 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-a6be2e62-729b-45d6-a9af-eb5f414a8410 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/77c3697a-5b72-4f66-9ba0-0fba67484286" status: 200 len: 1368 microversion: 2.1 time: 0.203560 Aug 27 02:24:54.051388 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 315/641] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:53 2022] GET /compute/v2.1/servers/77c3697a-5b72-4f66-9ba0-0fba67484286 => generated 1368 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:24:54.359318 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-2b877547-42bf-41a2-8ab0-e99cf0dc2fd2 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:54.360215 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-2b877547-42bf-41a2-8ab0-e99cf0dc2fd2 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 1b9390be-aab0-4240-83d9-0f815f094605] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:54.369499 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2b877547-42bf-41a2-8ab0-e99cf0dc2fd2 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:54.370001 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2b877547-42bf-41a2-8ab0-e99cf0dc2fd2 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:54.370439 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2b877547-42bf-41a2-8ab0-e99cf0dc2fd2 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:54.371179 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2b877547-42bf-41a2-8ab0-e99cf0dc2fd2 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:54.371633 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2b877547-42bf-41a2-8ab0-e99cf0dc2fd2 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:54.372059 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2b877547-42bf-41a2-8ab0-e99cf0dc2fd2 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:54.520769 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-2b877547-42bf-41a2-8ab0-e99cf0dc2fd2 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:54.532056 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-2b877547-42bf-41a2-8ab0-e99cf0dc2fd2 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605" status: 200 len: 1714 microversion: 2.1 time: 0.177226 Aug 27 02:24:54.532784 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 327/642] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:54 2022] GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605 => generated 1714 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:24:54.661865 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-9a0a215c-20f8-4a43-bd91-5f3af9877e7f tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:54.662406 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-9a0a215c-20f8-4a43-bd91-5f3af9877e7f tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 1b9390be-aab0-4240-83d9-0f815f094605] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:54.670346 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9a0a215c-20f8-4a43-bd91-5f3af9877e7f tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:54.670834 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9a0a215c-20f8-4a43-bd91-5f3af9877e7f tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:54.671259 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9a0a215c-20f8-4a43-bd91-5f3af9877e7f tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:54.671965 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9a0a215c-20f8-4a43-bd91-5f3af9877e7f tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:54.672404 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9a0a215c-20f8-4a43-bd91-5f3af9877e7f tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:54.672818 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9a0a215c-20f8-4a43-bd91-5f3af9877e7f tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:54.764290 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.wsgi [None req-9a0a215c-20f8-4a43-bd91-5f3af9877e7f tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] HTTP exception thrown: Cannot 'detach_volume' instance 1b9390be-aab0-4240-83d9-0f815f094605 while it is in vm_state rescued Aug 27 02:24:54.766420 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-9a0a215c-20f8-4a43-bd91-5f3af9877e7f tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Request method failure captured: Aug 27 02:24:54.766420 dv-cinder-846303-3-smb devstack@n-api.service[120783]: request: DELETE /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605/os-volume_attachments/614bb599-3532-4c25-b75a-988e7b9264ac HTTP/1.1 Aug 27 02:24:54.766420 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Accept: application/json Aug 27 02:24:54.766420 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Accept-Encoding: identity Aug 27 02:24:54.766420 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Connection: close Aug 27 02:24:54.766420 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Content-Length: 0 Aug 27 02:24:54.766420 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Content-Type: application/json Aug 27 02:24:54.766420 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Host: 10.222.0.61 Aug 27 02:24:54.766420 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Openstack-System-Scope: None Aug 27 02:24:54.766420 dv-cinder-846303-3-smb devstack@n-api.service[120783]: User-Agent: python-urllib3/1.26.11 Aug 27 02:24:54.766420 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Auth-Token: gAAAAABjCX-CxsQboupe7LGVgMB3IvNk6DZKE8jyi_9nbzm-Wvf3iOAH1nHoxh235cCKiWLsOX-TSw1YO5xdAHVdx_5iwsz77LAdzGTVwjuAfG2PP9Jsj1PrgoZ4Q6XQRHgC6UAoTOMizINS2RlKs2CbHJ_FMN6pGKDTXTr1l-0RRb1mYFgkHEU Aug 27 02:24:54.766420 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Domain-Id: None Aug 27 02:24:54.766420 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Domain-Name: None Aug 27 02:24:54.766420 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Identity-Status: Confirmed Aug 27 02:24:54.766420 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Is-Admin-Project: True Aug 27 02:24:54.766420 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Project-Domain-Id: default Aug 27 02:24:54.766420 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Project-Domain-Name: Default Aug 27 02:24:54.766420 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Project-Id: 67209b74f2fa4ae7ad9762d141378a5d Aug 27 02:24:54.766420 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1743925357 Aug 27 02:24:54.766420 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Role: member,reader Aug 27 02:24:54.766420 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Roles: member,reader Aug 27 02:24:54.768883 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/67209b74f2fa4ae7ad9762d141378a5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_67209b74f2fa4ae7ad9762d141378a5d", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/67209b74f2fa4ae7ad9762d141378a5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/67209b74f2fa4ae7ad9762d141378a5d"}]}] Aug 27 02:24:54.768883 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1743925357 Aug 27 02:24:54.768883 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Tenant-Id: 67209b74f2fa4ae7ad9762d141378a5d Aug 27 02:24:54.768883 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1743925357 Aug 27 02:24:54.768883 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User: tempest-ServerRescueNegativeTestJSON-1743925357-project Aug 27 02:24:54.768883 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User-Domain-Id: default Aug 27 02:24:54.768883 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User-Domain-Name: Default Aug 27 02:24:54.768883 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User-Id: 1eb664209056410d890d1b2b8bfa0155 Aug 27 02:24:54.768883 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1743925357-project Aug 27 02:24:54.768883 dv-cinder-846303-3-smb devstack@n-api.service[120783]: method: > Aug 27 02:24:54.768883 dv-cinder-846303-3-smb devstack@n-api.service[120783]: exception: Cannot 'detach_volume' instance 1b9390be-aab0-4240-83d9-0f815f094605 while it is in vm_state rescued Aug 27 02:24:54.770304 dv-cinder-846303-3-smb devstack@n-api.service[120783]: action_args: {'server_id': '1b9390be-aab0-4240-83d9-0f815f094605', 'id': '614bb599-3532-4c25-b75a-988e7b9264ac'} Aug 27 02:24:54.770304 dv-cinder-846303-3-smb devstack@n-api.service[120783]: {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:24:54.770304 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:24:54.770304 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 27 02:24:54.770304 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 27 02:24:54.770304 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 02:24:54.770304 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 02:24:54.770304 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 27 02:24:54.770304 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 27 02:24:54.770304 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1b9390be-aab0-4240-83d9-0f815f094605 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 27 02:24:54.770304 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:24:54.770304 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:24:54.770304 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:24:54.770304 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:24:54.770304 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:24:54.770304 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:24:54.770304 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:24:54.770304 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:24:54.770304 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:24:54.770304 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:24:54.772510 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 27 02:24:54.772510 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 27 02:24:54.772510 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 27 02:24:54.772510 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 27 02:24:54.772510 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 1b9390be-aab0-4240-83d9-0f815f094605 while it is in vm_state rescued Aug 27 02:24:54.772510 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:24:54.772510 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:24:54.772510 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:24:54.772510 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:24:54.772510 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:24:54.772510 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:24:54.772510 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:24:54.772510 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:24:54.772510 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 1b9390be-aab0-4240-83d9-0f815f094605 while it is in vm_state rescued Aug 27 02:24:54.772510 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:24:54.772510 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-9a0a215c-20f8-4a43-bd91-5f3af9877e7f tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Returning 409 to user: Cannot 'detach_volume' instance 1b9390be-aab0-4240-83d9-0f815f094605 while it is in vm_state rescued {{(pid=120783) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:24:54.774278 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-9a0a215c-20f8-4a43-bd91-5f3af9877e7f tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "DELETE /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605/os-volume_attachments/614bb599-3532-4c25-b75a-988e7b9264ac" status: 409 len: 152 microversion: 2.1 time: 0.111030 Aug 27 02:24:54.774278 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 316/643] 10.222.0.61 () {58 vars in 1416 bytes} [Sat Aug 27 02:24:54 2022] DELETE /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605/os-volume_attachments/614bb599-3532-4c25-b75a-988e7b9264ac => generated 152 bytes in 113 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 02:24:54.784961 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-c130fc7d-2367-40bc-99bf-e85b40951b6e tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:24:54.785985 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-c130fc7d-2367-40bc-99bf-e85b40951b6e tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 1b9390be-aab0-4240-83d9-0f815f094605] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:54.796765 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c130fc7d-2367-40bc-99bf-e85b40951b6e tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:54.797708 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c130fc7d-2367-40bc-99bf-e85b40951b6e tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:54.798479 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c130fc7d-2367-40bc-99bf-e85b40951b6e tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:54.799794 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c130fc7d-2367-40bc-99bf-e85b40951b6e tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:54.800612 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c130fc7d-2367-40bc-99bf-e85b40951b6e tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:54.801415 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c130fc7d-2367-40bc-99bf-e85b40951b6e tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:54.929902 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-c130fc7d-2367-40bc-99bf-e85b40951b6e tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "POST /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605/action" status: 202 len: 0 microversion: 2.1 time: 0.152051 Aug 27 02:24:54.931084 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 328/644] 10.222.0.61 () {60 vars in 1278 bytes} [Sat Aug 27 02:24:54 2022] POST /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605/action => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:24:54.939927 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-9bb6e61b-a777-4ad2-aeeb-15b3b5cb38f2 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:54.940646 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-9bb6e61b-a777-4ad2-aeeb-15b3b5cb38f2 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 1b9390be-aab0-4240-83d9-0f815f094605] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:54.947678 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9bb6e61b-a777-4ad2-aeeb-15b3b5cb38f2 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:54.948164 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9bb6e61b-a777-4ad2-aeeb-15b3b5cb38f2 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:54.948594 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9bb6e61b-a777-4ad2-aeeb-15b3b5cb38f2 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:54.949293 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9bb6e61b-a777-4ad2-aeeb-15b3b5cb38f2 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:54.949777 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9bb6e61b-a777-4ad2-aeeb-15b3b5cb38f2 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:54.950200 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9bb6e61b-a777-4ad2-aeeb-15b3b5cb38f2 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:55.086533 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-7ee38c41-cae1-494d-9287-1475cf3a45a5 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:55.087679 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-7ee38c41-cae1-494d-9287-1475cf3a45a5 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: 77c3697a-5b72-4f66-9ba0-0fba67484286] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:55.095641 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7ee38c41-cae1-494d-9287-1475cf3a45a5 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:55.096223 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7ee38c41-cae1-494d-9287-1475cf3a45a5 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:55.096731 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7ee38c41-cae1-494d-9287-1475cf3a45a5 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:55.097835 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7ee38c41-cae1-494d-9287-1475cf3a45a5 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:55.098457 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7ee38c41-cae1-494d-9287-1475cf3a45a5 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:55.099010 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7ee38c41-cae1-494d-9287-1475cf3a45a5 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:55.117956 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-9bb6e61b-a777-4ad2-aeeb-15b3b5cb38f2 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:55.128983 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-9bb6e61b-a777-4ad2-aeeb-15b3b5cb38f2 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605" status: 200 len: 1722 microversion: 2.1 time: 0.192547 Aug 27 02:24:55.130081 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 317/645] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:54 2022] GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605 => generated 1722 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:24:55.258839 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-7ee38c41-cae1-494d-9287-1475cf3a45a5 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6f819365574091ae344f14e47f487f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa1c411b57d4e72885dac2b4f4dfe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:55.267702 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-7ee38c41-cae1-494d-9287-1475cf3a45a5 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/77c3697a-5b72-4f66-9ba0-0fba67484286" status: 200 len: 1368 microversion: 2.1 time: 0.186979 Aug 27 02:24:55.268293 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 329/646] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:55 2022] GET /compute/v2.1/servers/77c3697a-5b72-4f66-9ba0-0fba67484286 => generated 1368 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:24:56.153212 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-aafd08c4-ac45-44d0-919f-1c9bbf55cab9 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:56.154237 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-aafd08c4-ac45-44d0-919f-1c9bbf55cab9 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 1b9390be-aab0-4240-83d9-0f815f094605] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:56.161773 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-aafd08c4-ac45-44d0-919f-1c9bbf55cab9 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:56.162373 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-aafd08c4-ac45-44d0-919f-1c9bbf55cab9 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:56.162870 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-aafd08c4-ac45-44d0-919f-1c9bbf55cab9 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:56.163663 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-aafd08c4-ac45-44d0-919f-1c9bbf55cab9 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:56.164233 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-aafd08c4-ac45-44d0-919f-1c9bbf55cab9 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:56.164759 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-aafd08c4-ac45-44d0-919f-1c9bbf55cab9 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:56.289550 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-5c13a87d-79f0-4c39-9038-55f76f0665a9 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:56.290382 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-5c13a87d-79f0-4c39-9038-55f76f0665a9 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: 77c3697a-5b72-4f66-9ba0-0fba67484286] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:56.298459 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5c13a87d-79f0-4c39-9038-55f76f0665a9 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:56.299245 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5c13a87d-79f0-4c39-9038-55f76f0665a9 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:56.299777 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5c13a87d-79f0-4c39-9038-55f76f0665a9 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:56.300612 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5c13a87d-79f0-4c39-9038-55f76f0665a9 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:56.301187 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5c13a87d-79f0-4c39-9038-55f76f0665a9 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:56.301743 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5c13a87d-79f0-4c39-9038-55f76f0665a9 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:56.310011 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-aafd08c4-ac45-44d0-919f-1c9bbf55cab9 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:56.310695 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:24:56.323698 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-aafd08c4-ac45-44d0-919f-1c9bbf55cab9 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605" status: 200 len: 1722 microversion: 2.1 time: 0.174214 Aug 27 02:24:56.338009 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 318/647] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:56 2022] GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605 => generated 1722 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:24:56.519643 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-5c13a87d-79f0-4c39-9038-55f76f0665a9 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6f819365574091ae344f14e47f487f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa1c411b57d4e72885dac2b4f4dfe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:56.528657 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-5c13a87d-79f0-4c39-9038-55f76f0665a9 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/77c3697a-5b72-4f66-9ba0-0fba67484286" status: 200 len: 1368 microversion: 2.1 time: 0.243802 Aug 27 02:24:56.529345 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 330/648] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:56 2022] GET /compute/v2.1/servers/77c3697a-5b72-4f66-9ba0-0fba67484286 => generated 1368 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:24:56.638250 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [req-af86f255-c1b4-4f9f-93f1-7f759d77d0d3 req-f6423b9c-50cc-4d2f-b159-f0382131adf7 admin admin] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:56.642253 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-af86f255-c1b4-4f9f-93f1-7f759d77d0d3 req-f6423b9c-50cc-4d2f-b159-f0382131adf7 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:56.642747 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-af86f255-c1b4-4f9f-93f1-7f759d77d0d3 req-f6423b9c-50cc-4d2f-b159-f0382131adf7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:56.643177 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-af86f255-c1b4-4f9f-93f1-7f759d77d0d3 req-f6423b9c-50cc-4d2f-b159-f0382131adf7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:56.651966 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-af86f255-c1b4-4f9f-93f1-7f759d77d0d3 req-f6423b9c-50cc-4d2f-b159-f0382131adf7 admin admin] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:56.652437 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-af86f255-c1b4-4f9f-93f1-7f759d77d0d3 req-f6423b9c-50cc-4d2f-b159-f0382131adf7 admin admin] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:56.652867 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-af86f255-c1b4-4f9f-93f1-7f759d77d0d3 req-f6423b9c-50cc-4d2f-b159-f0382131adf7 admin admin] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:56.671613 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [req-af86f255-c1b4-4f9f-93f1-7f759d77d0d3 req-f6423b9c-50cc-4d2f-b159-f0382131adf7 admin admin] 10.222.0.78 "DELETE /compute/v2.1/os-assisted-volume-snapshots/b3784b70-5225-4e83-af90-a82a6b715aca?delete_info=%7B%22file_to_merge%22:%20%22volume-355d390d-2815-43dc-97ef-cb85c177b3f0.b3784b70-5225-4e83-af90-a82a6b715aca.vhdx%22,%20%22volume_id%22:%20%22355d390d-2815-43dc-97ef-cb85c177b3f0%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.098980 Aug 27 02:24:56.672434 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 319/649] 10.222.0.78 () {62 vars in 1800 bytes} [Sat Aug 27 02:24:56 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/b3784b70-5225-4e83-af90-a82a6b715aca?delete_info=%7B%22file_to_merge%22:%20%22volume-355d390d-2815-43dc-97ef-cb85c177b3f0.b3784b70-5225-4e83-af90-a82a6b715aca.vhdx%22,%20%22volume_id%22:%20%22355d390d-2815-43dc-97ef-cb85c177b3f0%22%7D => generated 0 bytes in 101 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 02:24:57.359211 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-422673ca-5a09-4a5b-839a-7d86572f2adf tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:57.360071 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-422673ca-5a09-4a5b-839a-7d86572f2adf tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 1b9390be-aab0-4240-83d9-0f815f094605] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:57.368182 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-422673ca-5a09-4a5b-839a-7d86572f2adf tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:57.368713 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-422673ca-5a09-4a5b-839a-7d86572f2adf tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:57.369146 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-422673ca-5a09-4a5b-839a-7d86572f2adf tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:57.369950 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-422673ca-5a09-4a5b-839a-7d86572f2adf tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:57.370404 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-422673ca-5a09-4a5b-839a-7d86572f2adf tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:57.370834 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-422673ca-5a09-4a5b-839a-7d86572f2adf tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:57.528176 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-422673ca-5a09-4a5b-839a-7d86572f2adf tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:57.537527 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-422673ca-5a09-4a5b-839a-7d86572f2adf tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605" status: 200 len: 1722 microversion: 2.1 time: 0.182420 Aug 27 02:24:57.538122 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 331/650] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:57 2022] GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605 => generated 1722 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:24:57.564489 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-b450a3ba-ce83-466b-9ef4-cbe4511dfb4e tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:57.565242 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-b450a3ba-ce83-466b-9ef4-cbe4511dfb4e tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: 77c3697a-5b72-4f66-9ba0-0fba67484286] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:57.567426 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=1 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:24:57.573854 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b450a3ba-ce83-466b-9ef4-cbe4511dfb4e tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:57.574357 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b450a3ba-ce83-466b-9ef4-cbe4511dfb4e tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:57.574804 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b450a3ba-ce83-466b-9ef4-cbe4511dfb4e tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:57.575527 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b450a3ba-ce83-466b-9ef4-cbe4511dfb4e tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:57.575983 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b450a3ba-ce83-466b-9ef4-cbe4511dfb4e tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:57.576408 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b450a3ba-ce83-466b-9ef4-cbe4511dfb4e tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:57.722877 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-b450a3ba-ce83-466b-9ef4-cbe4511dfb4e tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6f819365574091ae344f14e47f487f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa1c411b57d4e72885dac2b4f4dfe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:57.731130 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-b450a3ba-ce83-466b-9ef4-cbe4511dfb4e tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/77c3697a-5b72-4f66-9ba0-0fba67484286" status: 200 len: 1368 microversion: 2.1 time: 0.171628 Aug 27 02:24:57.731713 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 320/651] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:57 2022] GET /compute/v2.1/servers/77c3697a-5b72-4f66-9ba0-0fba67484286 => generated 1368 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:24:58.573861 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-10f5d172-9186-4312-9301-ed16516aab3a tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:58.574936 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-10f5d172-9186-4312-9301-ed16516aab3a tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 1b9390be-aab0-4240-83d9-0f815f094605] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:58.586708 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-10f5d172-9186-4312-9301-ed16516aab3a tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:58.587549 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-10f5d172-9186-4312-9301-ed16516aab3a tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:58.588260 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-10f5d172-9186-4312-9301-ed16516aab3a tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:58.589920 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-10f5d172-9186-4312-9301-ed16516aab3a tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:58.590855 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-10f5d172-9186-4312-9301-ed16516aab3a tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:58.591925 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-10f5d172-9186-4312-9301-ed16516aab3a tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:58.754477 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-d4e3430f-f897-4b2e-8016-45bdc5b9dc1c tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:58.755942 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-d4e3430f-f897-4b2e-8016-45bdc5b9dc1c tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: 77c3697a-5b72-4f66-9ba0-0fba67484286] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:58.764055 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-10f5d172-9186-4312-9301-ed16516aab3a tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:58.765261 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d4e3430f-f897-4b2e-8016-45bdc5b9dc1c tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:58.766242 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d4e3430f-f897-4b2e-8016-45bdc5b9dc1c tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:58.766762 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d4e3430f-f897-4b2e-8016-45bdc5b9dc1c tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:58.767778 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d4e3430f-f897-4b2e-8016-45bdc5b9dc1c tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:58.768387 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d4e3430f-f897-4b2e-8016-45bdc5b9dc1c tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:58.769110 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d4e3430f-f897-4b2e-8016-45bdc5b9dc1c tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:58.776441 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-10f5d172-9186-4312-9301-ed16516aab3a tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605" status: 200 len: 1722 microversion: 2.1 time: 0.208073 Aug 27 02:24:58.777471 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 332/652] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:58 2022] GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605 => generated 1722 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:24:58.794383 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:24:58.925160 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-d4e3430f-f897-4b2e-8016-45bdc5b9dc1c tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6f819365574091ae344f14e47f487f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa1c411b57d4e72885dac2b4f4dfe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:24:58.934363 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-d4e3430f-f897-4b2e-8016-45bdc5b9dc1c tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/77c3697a-5b72-4f66-9ba0-0fba67484286" status: 200 len: 1559 microversion: 2.1 time: 0.185254 Aug 27 02:24:58.934943 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 321/653] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:58 2022] GET /compute/v2.1/servers/77c3697a-5b72-4f66-9ba0-0fba67484286 => generated 1559 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:24:58.955091 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-dd22bcbd-5e1d-405f-9493-6addbbe2ab56 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:58.955588 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-dd22bcbd-5e1d-405f-9493-6addbbe2ab56 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: 77c3697a-5b72-4f66-9ba0-0fba67484286] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:58.962569 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-dd22bcbd-5e1d-405f-9493-6addbbe2ab56 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:58.963073 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-dd22bcbd-5e1d-405f-9493-6addbbe2ab56 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:58.963504 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-dd22bcbd-5e1d-405f-9493-6addbbe2ab56 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:58.964218 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-dd22bcbd-5e1d-405f-9493-6addbbe2ab56 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:58.964694 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-dd22bcbd-5e1d-405f-9493-6addbbe2ab56 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:58.965110 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-dd22bcbd-5e1d-405f-9493-6addbbe2ab56 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:59.056700 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-dd22bcbd-5e1d-405f-9493-6addbbe2ab56 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/77c3697a-5b72-4f66-9ba0-0fba67484286/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.105278 Aug 27 02:24:59.057763 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 333/654] 10.222.0.61 () {58 vars in 1275 bytes} [Sat Aug 27 02:24:58 2022] GET /compute/v2.1/servers/77c3697a-5b72-4f66-9ba0-0fba67484286/os-interface => generated 285 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:24:59.797150 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-8d68a209-f645-4d47-9861-bbdc133f978e tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:24:59.797795 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-8d68a209-f645-4d47-9861-bbdc133f978e tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 1b9390be-aab0-4240-83d9-0f815f094605] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:24:59.806281 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8d68a209-f645-4d47-9861-bbdc133f978e tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:59.806931 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8d68a209-f645-4d47-9861-bbdc133f978e tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:59.807366 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8d68a209-f645-4d47-9861-bbdc133f978e tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:24:59.808080 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8d68a209-f645-4d47-9861-bbdc133f978e tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:24:59.808533 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8d68a209-f645-4d47-9861-bbdc133f978e tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:24:59.808961 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8d68a209-f645-4d47-9861-bbdc133f978e tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:00.052516 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-8d68a209-f645-4d47-9861-bbdc133f978e tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:25:00.061949 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-8d68a209-f645-4d47-9861-bbdc133f978e tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605" status: 200 len: 1722 microversion: 2.1 time: 0.268662 Aug 27 02:25:00.062535 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 322/655] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:24:59 2022] GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605 => generated 1722 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:25:00.290190 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [req-0169061e-a041-4234-9629-60a7a9505666 req-da02bfdc-725e-4e5d-b439-2dde57846879 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77c3697a-5b72-4f66-9ba0-0fba67484286", "tag": "0920aabe-2380-40e3-a6ac-3334ec3130a5"}]} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:25:00.302197 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-0169061e-a041-4234-9629-60a7a9505666 req-da02bfdc-725e-4e5d-b439-2dde57846879 service nova] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:00.302689 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-0169061e-a041-4234-9629-60a7a9505666 req-da02bfdc-725e-4e5d-b439-2dde57846879 service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:00.303127 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-0169061e-a041-4234-9629-60a7a9505666 req-da02bfdc-725e-4e5d-b439-2dde57846879 service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:00.316873 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.compute.server_external_events [req-0169061e-a041-4234-9629-60a7a9505666 req-da02bfdc-725e-4e5d-b439-2dde57846879 service nova] Creating event network-changed:0920aabe-2380-40e3-a6ac-3334ec3130a5 for instance 77c3697a-5b72-4f66-9ba0-0fba67484286 on hv-cinder-84630 Aug 27 02:25:00.322549 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [req-0169061e-a041-4234-9629-60a7a9505666 req-da02bfdc-725e-4e5d-b439-2dde57846879 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036626 Aug 27 02:25:00.323160 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 334/656] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Aug 27 02:25:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:25:01.085342 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-2fdf2c74-bc9c-4d86-939d-9b71666c2f47 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:25:01.086466 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-2fdf2c74-bc9c-4d86-939d-9b71666c2f47 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 1b9390be-aab0-4240-83d9-0f815f094605] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:25:01.094112 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2fdf2c74-bc9c-4d86-939d-9b71666c2f47 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:01.094737 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2fdf2c74-bc9c-4d86-939d-9b71666c2f47 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:01.095432 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2fdf2c74-bc9c-4d86-939d-9b71666c2f47 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:01.096567 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2fdf2c74-bc9c-4d86-939d-9b71666c2f47 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:01.097262 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2fdf2c74-bc9c-4d86-939d-9b71666c2f47 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:01.097767 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2fdf2c74-bc9c-4d86-939d-9b71666c2f47 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:01.311117 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-2fdf2c74-bc9c-4d86-939d-9b71666c2f47 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:25:01.328067 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-2fdf2c74-bc9c-4d86-939d-9b71666c2f47 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605" status: 200 len: 1722 microversion: 2.1 time: 0.247360 Aug 27 02:25:01.329005 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 323/657] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:25:01 2022] GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605 => generated 1722 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:25:01.866843 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell0:SELECT=6 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:25:01.940226 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [req-2896bfc1-f33e-4751-a1e6-a380d57ffc39 req-55bd0569-00e9-4e8c-b333-4a1340e0d171 admin admin] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:25:01.944015 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-2896bfc1-f33e-4751-a1e6-a380d57ffc39 req-55bd0569-00e9-4e8c-b333-4a1340e0d171 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:01.944626 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-2896bfc1-f33e-4751-a1e6-a380d57ffc39 req-55bd0569-00e9-4e8c-b333-4a1340e0d171 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:01.945103 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-2896bfc1-f33e-4751-a1e6-a380d57ffc39 req-55bd0569-00e9-4e8c-b333-4a1340e0d171 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:01.954945 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-2896bfc1-f33e-4751-a1e6-a380d57ffc39 req-55bd0569-00e9-4e8c-b333-4a1340e0d171 admin admin] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:01.955432 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-2896bfc1-f33e-4751-a1e6-a380d57ffc39 req-55bd0569-00e9-4e8c-b333-4a1340e0d171 admin admin] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:01.955858 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-2896bfc1-f33e-4751-a1e6-a380d57ffc39 req-55bd0569-00e9-4e8c-b333-4a1340e0d171 admin admin] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:01.971871 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [req-2896bfc1-f33e-4751-a1e6-a380d57ffc39 req-55bd0569-00e9-4e8c-b333-4a1340e0d171 admin admin] 10.222.0.78 "DELETE /compute/v2.1/os-assisted-volume-snapshots/c340a510-9658-4471-b87d-7a756213edd4?delete_info=%7B%22file_to_merge%22:%20%22volume-355d390d-2815-43dc-97ef-cb85c177b3f0.c340a510-9658-4471-b87d-7a756213edd4.vhdx%22,%20%22volume_id%22:%20%22355d390d-2815-43dc-97ef-cb85c177b3f0%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.111225 Aug 27 02:25:01.972467 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 335/658] 10.222.0.78 () {62 vars in 1800 bytes} [Sat Aug 27 02:25:01 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/c340a510-9658-4471-b87d-7a756213edd4?delete_info=%7B%22file_to_merge%22:%20%22volume-355d390d-2815-43dc-97ef-cb85c177b3f0.c340a510-9658-4471-b87d-7a756213edd4.vhdx%22,%20%22volume_id%22:%20%22355d390d-2815-43dc-97ef-cb85c177b3f0%22%7D => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:25:02.351057 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-aa7005d9-0537-4c0f-8f9b-af6401de2d5e tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:25:02.352736 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-aa7005d9-0537-4c0f-8f9b-af6401de2d5e tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 1b9390be-aab0-4240-83d9-0f815f094605] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:25:02.367932 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-aa7005d9-0537-4c0f-8f9b-af6401de2d5e tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:02.368810 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-aa7005d9-0537-4c0f-8f9b-af6401de2d5e tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:02.369662 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-aa7005d9-0537-4c0f-8f9b-af6401de2d5e tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:02.370994 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-aa7005d9-0537-4c0f-8f9b-af6401de2d5e tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:02.371926 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-aa7005d9-0537-4c0f-8f9b-af6401de2d5e tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:02.372598 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-aa7005d9-0537-4c0f-8f9b-af6401de2d5e tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:02.608496 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-aa7005d9-0537-4c0f-8f9b-af6401de2d5e tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:25:02.618350 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-aa7005d9-0537-4c0f-8f9b-af6401de2d5e tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605" status: 200 len: 1722 microversion: 2.1 time: 0.271538 Aug 27 02:25:02.618944 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 324/659] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:25:02 2022] GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605 => generated 1722 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:25:03.641657 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-4c92eab5-6a34-4814-a7f7-fc5897c6c9ef tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:25:03.642726 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-4c92eab5-6a34-4814-a7f7-fc5897c6c9ef tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 1b9390be-aab0-4240-83d9-0f815f094605] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:25:03.650193 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4c92eab5-6a34-4814-a7f7-fc5897c6c9ef tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:03.650678 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4c92eab5-6a34-4814-a7f7-fc5897c6c9ef tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:03.651088 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4c92eab5-6a34-4814-a7f7-fc5897c6c9ef tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:03.651808 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4c92eab5-6a34-4814-a7f7-fc5897c6c9ef tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:03.652254 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4c92eab5-6a34-4814-a7f7-fc5897c6c9ef tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:03.652668 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4c92eab5-6a34-4814-a7f7-fc5897c6c9ef tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:03.803864 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-4c92eab5-6a34-4814-a7f7-fc5897c6c9ef tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:25:03.814292 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-4c92eab5-6a34-4814-a7f7-fc5897c6c9ef tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605" status: 200 len: 1728 microversion: 2.1 time: 0.177835 Aug 27 02:25:03.815015 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 336/660] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:25:03 2022] GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605 => generated 1728 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:25:03.840394 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-198dc99c-93b7-4646-bc77-6f64e917c949 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:25:03.841168 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-198dc99c-93b7-4646-bc77-6f64e917c949 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 1b9390be-aab0-4240-83d9-0f815f094605] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:25:03.852746 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-198dc99c-93b7-4646-bc77-6f64e917c949 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:03.853642 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-198dc99c-93b7-4646-bc77-6f64e917c949 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:03.854395 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-198dc99c-93b7-4646-bc77-6f64e917c949 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:03.855618 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-198dc99c-93b7-4646-bc77-6f64e917c949 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:03.856426 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-198dc99c-93b7-4646-bc77-6f64e917c949 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:03.857207 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-198dc99c-93b7-4646-bc77-6f64e917c949 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:03.950919 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-198dc99c-93b7-4646-bc77-6f64e917c949 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.118211 Aug 27 02:25:03.951605 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 325/661] 10.222.0.61 () {58 vars in 1275 bytes} [Sat Aug 27 02:25:03 2022] GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605/os-interface => generated 284 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:25:05.486811 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [req-2bf897a4-abb5-457d-9040-797a55532060 req-e3b02dd1-7421-4bd3-8063-f814bb8ffcff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b9390be-aab0-4240-83d9-0f815f094605", "tag": "2d52c295-4b5b-44d1-aa5d-fbba4fb2a454"}]} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:25:05.506351 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-2bf897a4-abb5-457d-9040-797a55532060 req-e3b02dd1-7421-4bd3-8063-f814bb8ffcff service nova] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:05.507117 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-2bf897a4-abb5-457d-9040-797a55532060 req-e3b02dd1-7421-4bd3-8063-f814bb8ffcff service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:05.507894 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-2bf897a4-abb5-457d-9040-797a55532060 req-e3b02dd1-7421-4bd3-8063-f814bb8ffcff service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:05.525902 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.compute.server_external_events [req-2bf897a4-abb5-457d-9040-797a55532060 req-e3b02dd1-7421-4bd3-8063-f814bb8ffcff service nova] Creating event network-changed:2d52c295-4b5b-44d1-aa5d-fbba4fb2a454 for instance 1b9390be-aab0-4240-83d9-0f815f094605 on hv-cinder-84630 Aug 27 02:25:05.531366 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [req-2bf897a4-abb5-457d-9040-797a55532060 req-e3b02dd1-7421-4bd3-8063-f814bb8ffcff service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051396 Aug 27 02:25:05.531987 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 337/662] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Aug 27 02:25:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:25:07.169002 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell0:SELECT=2 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:25:07.234851 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [req-6a8091c5-3511-44f3-95b2-22fd38ffbceb req-8ac1bd54-3cfe-4266-b3d4-08ced90199bb admin admin] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:25:07.238621 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-6a8091c5-3511-44f3-95b2-22fd38ffbceb req-8ac1bd54-3cfe-4266-b3d4-08ced90199bb admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:07.239116 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-6a8091c5-3511-44f3-95b2-22fd38ffbceb req-8ac1bd54-3cfe-4266-b3d4-08ced90199bb admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:07.239544 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-6a8091c5-3511-44f3-95b2-22fd38ffbceb req-8ac1bd54-3cfe-4266-b3d4-08ced90199bb admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:07.249071 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-6a8091c5-3511-44f3-95b2-22fd38ffbceb req-8ac1bd54-3cfe-4266-b3d4-08ced90199bb admin admin] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:07.249621 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-6a8091c5-3511-44f3-95b2-22fd38ffbceb req-8ac1bd54-3cfe-4266-b3d4-08ced90199bb admin admin] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:07.250048 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-6a8091c5-3511-44f3-95b2-22fd38ffbceb req-8ac1bd54-3cfe-4266-b3d4-08ced90199bb admin admin] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:07.267113 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [req-6a8091c5-3511-44f3-95b2-22fd38ffbceb req-8ac1bd54-3cfe-4266-b3d4-08ced90199bb admin admin] 10.222.0.78 "DELETE /compute/v2.1/os-assisted-volume-snapshots/3be159a0-1be3-480e-8676-052d92099036?delete_info=%7B%22file_to_merge%22:%20%22volume-355d390d-2815-43dc-97ef-cb85c177b3f0.3be159a0-1be3-480e-8676-052d92099036.vhdx%22,%20%22volume_id%22:%20%22355d390d-2815-43dc-97ef-cb85c177b3f0%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.099038 Aug 27 02:25:07.267806 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 326/663] 10.222.0.78 () {62 vars in 1800 bytes} [Sat Aug 27 02:25:07 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/3be159a0-1be3-480e-8676-052d92099036?delete_info=%7B%22file_to_merge%22:%20%22volume-355d390d-2815-43dc-97ef-cb85c177b3f0.3be159a0-1be3-480e-8676-052d92099036.vhdx%22,%20%22volume_id%22:%20%22355d390d-2815-43dc-97ef-cb85c177b3f0%22%7D => generated 0 bytes in 101 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:25:07.550276 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [req-665e33c0-d357-4ecf-8237-848336450862 req-01503892-dcbf-4d0f-b50c-a06d93b7bef0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b9390be-aab0-4240-83d9-0f815f094605", "tag": "2d52c295-4b5b-44d1-aa5d-fbba4fb2a454"}]} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:25:07.560949 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-665e33c0-d357-4ecf-8237-848336450862 req-01503892-dcbf-4d0f-b50c-a06d93b7bef0 service nova] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:07.561462 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-665e33c0-d357-4ecf-8237-848336450862 req-01503892-dcbf-4d0f-b50c-a06d93b7bef0 service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:07.561902 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-665e33c0-d357-4ecf-8237-848336450862 req-01503892-dcbf-4d0f-b50c-a06d93b7bef0 service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:07.574782 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.compute.server_external_events [req-665e33c0-d357-4ecf-8237-848336450862 req-01503892-dcbf-4d0f-b50c-a06d93b7bef0 service nova] Creating event network-changed:2d52c295-4b5b-44d1-aa5d-fbba4fb2a454 for instance 1b9390be-aab0-4240-83d9-0f815f094605 on hv-cinder-84630 Aug 27 02:25:07.580040 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [req-665e33c0-d357-4ecf-8237-848336450862 req-01503892-dcbf-4d0f-b50c-a06d93b7bef0 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034987 Aug 27 02:25:07.580650 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 338/664] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Aug 27 02:25:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:25:11.170317 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-026af056-0fdd-42b1-8262-38387271334d tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:25:11.171189 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-026af056-0fdd-42b1-8262-38387271334d tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] [instance: 4e641be3-227d-43c1-aa50-ecf2b89529c9] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:25:11.177723 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-026af056-0fdd-42b1-8262-38387271334d tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:11.178215 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-026af056-0fdd-42b1-8262-38387271334d tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:11.178649 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-026af056-0fdd-42b1-8262-38387271334d tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:11.179492 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-026af056-0fdd-42b1-8262-38387271334d tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:11.179943 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-026af056-0fdd-42b1-8262-38387271334d tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:11.180362 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-026af056-0fdd-42b1-8262-38387271334d tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:11.271250 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.objects.instance [None req-026af056-0fdd-42b1-8262-38387271334d tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lazy-loading 'services' on Instance uuid 4e641be3-227d-43c1-aa50-ecf2b89529c9 {{(pid=120783) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:25:11.373228 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-026af056-0fdd-42b1-8262-38387271334d tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] 10.222.0.61 "DELETE /compute/v2.1/servers/4e641be3-227d-43c1-aa50-ecf2b89529c9/os-volume_attachments/355d390d-2815-43dc-97ef-cb85c177b3f0" status: 202 len: 0 microversion: 2.1 time: 0.207727 Aug 27 02:25:11.373996 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 327/665] 10.222.0.61 () {58 vars in 1416 bytes} [Sat Aug 27 02:25:11 2022] DELETE /compute/v2.1/servers/4e641be3-227d-43c1-aa50-ecf2b89529c9/os-volume_attachments/355d390d-2815-43dc-97ef-cb85c177b3f0 => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:25:12.508950 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell0:SELECT=2 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:25:12.514404 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-16b22df6-e67d-46fb-a1fe-0e149f6ab3d3 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:25:12.514999 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-16b22df6-e67d-46fb-a1fe-0e149f6ab3d3 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] [instance: 4e641be3-227d-43c1-aa50-ecf2b89529c9] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:25:12.522827 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-16b22df6-e67d-46fb-a1fe-0e149f6ab3d3 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:12.523467 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-16b22df6-e67d-46fb-a1fe-0e149f6ab3d3 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:12.523913 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-16b22df6-e67d-46fb-a1fe-0e149f6ab3d3 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:12.524622 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-16b22df6-e67d-46fb-a1fe-0e149f6ab3d3 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:12.525067 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-16b22df6-e67d-46fb-a1fe-0e149f6ab3d3 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:12.525511 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-16b22df6-e67d-46fb-a1fe-0e149f6ab3d3 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:12.553636 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-16b22df6-e67d-46fb-a1fe-0e149f6ab3d3 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] [instance: 4e641be3-227d-43c1-aa50-ecf2b89529c9] Going to try to terminate instance {{(pid=120782) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:25:12.670923 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-16b22df6-e67d-46fb-a1fe-0e149f6ab3d3 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] 10.222.0.61 "DELETE /compute/v2.1/servers/4e641be3-227d-43c1-aa50-ecf2b89529c9" status: 204 len: 0 microversion: 2.1 time: 0.163260 Aug 27 02:25:12.671911 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 339/666] 10.222.0.61 () {58 vars in 1239 bytes} [Sat Aug 27 02:25:12 2022] DELETE /compute/v2.1/servers/4e641be3-227d-43c1-aa50-ecf2b89529c9 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:25:12.683561 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-8cf5e1c5-b7d1-42d6-9aa4-9db50ebb785d tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:25:12.684272 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-8cf5e1c5-b7d1-42d6-9aa4-9db50ebb785d tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] [instance: 4e641be3-227d-43c1-aa50-ecf2b89529c9] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:25:12.690942 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8cf5e1c5-b7d1-42d6-9aa4-9db50ebb785d tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:12.691424 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8cf5e1c5-b7d1-42d6-9aa4-9db50ebb785d tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:12.691857 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8cf5e1c5-b7d1-42d6-9aa4-9db50ebb785d tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:12.692561 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8cf5e1c5-b7d1-42d6-9aa4-9db50ebb785d tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:12.693015 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8cf5e1c5-b7d1-42d6-9aa4-9db50ebb785d tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:12.693459 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8cf5e1c5-b7d1-42d6-9aa4-9db50ebb785d tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:12.838716 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-8cf5e1c5-b7d1-42d6-9aa4-9db50ebb785d tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f931e726872474dae2b7b6fbb0eb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7bf59244bc487b84c7dbf9aa7314d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:25:12.847093 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-8cf5e1c5-b7d1-42d6-9aa4-9db50ebb785d tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] 10.222.0.61 "GET /compute/v2.1/servers/4e641be3-227d-43c1-aa50-ecf2b89529c9" status: 200 len: 1513 microversion: 2.1 time: 0.169538 Aug 27 02:25:12.847685 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 328/667] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:25:12 2022] GET /compute/v2.1/servers/4e641be3-227d-43c1-aa50-ecf2b89529c9 => generated 1513 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:25:13.870370 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-e902ef1f-142f-4f17-9da3-db3619c10686 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:25:13.871016 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-e902ef1f-142f-4f17-9da3-db3619c10686 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] [instance: 4e641be3-227d-43c1-aa50-ecf2b89529c9] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:25:13.878038 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e902ef1f-142f-4f17-9da3-db3619c10686 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:13.878704 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e902ef1f-142f-4f17-9da3-db3619c10686 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:13.879139 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e902ef1f-142f-4f17-9da3-db3619c10686 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:13.879992 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e902ef1f-142f-4f17-9da3-db3619c10686 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:13.880442 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e902ef1f-142f-4f17-9da3-db3619c10686 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:13.880858 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e902ef1f-142f-4f17-9da3-db3619c10686 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:14.047964 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-e902ef1f-142f-4f17-9da3-db3619c10686 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f931e726872474dae2b7b6fbb0eb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7bf59244bc487b84c7dbf9aa7314d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:25:14.056470 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-e902ef1f-142f-4f17-9da3-db3619c10686 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] 10.222.0.61 "GET /compute/v2.1/servers/4e641be3-227d-43c1-aa50-ecf2b89529c9" status: 200 len: 1513 microversion: 2.1 time: 0.190967 Aug 27 02:25:14.057071 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 340/668] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:25:13 2022] GET /compute/v2.1/servers/4e641be3-227d-43c1-aa50-ecf2b89529c9 => generated 1513 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:25:15.078307 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-6c07d977-dfd4-408e-8c6e-b4c9ae4bf438 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:25:15.078976 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-6c07d977-dfd4-408e-8c6e-b4c9ae4bf438 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] [instance: 4e641be3-227d-43c1-aa50-ecf2b89529c9] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:25:15.086160 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6c07d977-dfd4-408e-8c6e-b4c9ae4bf438 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:15.086647 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6c07d977-dfd4-408e-8c6e-b4c9ae4bf438 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:15.087076 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6c07d977-dfd4-408e-8c6e-b4c9ae4bf438 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:15.087774 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6c07d977-dfd4-408e-8c6e-b4c9ae4bf438 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:15.088197 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6c07d977-dfd4-408e-8c6e-b4c9ae4bf438 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:15.088646 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6c07d977-dfd4-408e-8c6e-b4c9ae4bf438 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:15.262412 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-6c07d977-dfd4-408e-8c6e-b4c9ae4bf438 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f931e726872474dae2b7b6fbb0eb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7bf59244bc487b84c7dbf9aa7314d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:25:15.272975 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-6c07d977-dfd4-408e-8c6e-b4c9ae4bf438 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] 10.222.0.61 "GET /compute/v2.1/servers/4e641be3-227d-43c1-aa50-ecf2b89529c9" status: 200 len: 1513 microversion: 2.1 time: 0.198708 Aug 27 02:25:15.273597 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 329/669] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:25:15 2022] GET /compute/v2.1/servers/4e641be3-227d-43c1-aa50-ecf2b89529c9 => generated 1513 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:25:16.308959 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-1b593ca0-95b2-4a6e-8c3f-956cbda5cc91 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:25:16.309844 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-1b593ca0-95b2-4a6e-8c3f-956cbda5cc91 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] [instance: 4e641be3-227d-43c1-aa50-ecf2b89529c9] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:25:16.321667 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1b593ca0-95b2-4a6e-8c3f-956cbda5cc91 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:16.322607 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1b593ca0-95b2-4a6e-8c3f-956cbda5cc91 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:16.323352 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1b593ca0-95b2-4a6e-8c3f-956cbda5cc91 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:16.324599 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1b593ca0-95b2-4a6e-8c3f-956cbda5cc91 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:16.325424 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1b593ca0-95b2-4a6e-8c3f-956cbda5cc91 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:16.326240 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1b593ca0-95b2-4a6e-8c3f-956cbda5cc91 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:16.484756 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-1b593ca0-95b2-4a6e-8c3f-956cbda5cc91 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f931e726872474dae2b7b6fbb0eb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7bf59244bc487b84c7dbf9aa7314d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:25:16.493934 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-1b593ca0-95b2-4a6e-8c3f-956cbda5cc91 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] 10.222.0.61 "GET /compute/v2.1/servers/4e641be3-227d-43c1-aa50-ecf2b89529c9" status: 200 len: 1513 microversion: 2.1 time: 0.189202 Aug 27 02:25:16.495323 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 341/670] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:25:16 2022] GET /compute/v2.1/servers/4e641be3-227d-43c1-aa50-ecf2b89529c9 => generated 1513 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:25:17.516731 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-5081442f-8009-4748-8fd3-acfd3d3e4e10 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:25:17.517441 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-5081442f-8009-4748-8fd3-acfd3d3e4e10 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] [instance: 4e641be3-227d-43c1-aa50-ecf2b89529c9] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:25:17.520013 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell0:SELECT=2 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:25:17.526258 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5081442f-8009-4748-8fd3-acfd3d3e4e10 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:17.526875 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5081442f-8009-4748-8fd3-acfd3d3e4e10 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:17.527397 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5081442f-8009-4748-8fd3-acfd3d3e4e10 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:17.528150 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5081442f-8009-4748-8fd3-acfd3d3e4e10 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:17.528645 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5081442f-8009-4748-8fd3-acfd3d3e4e10 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:17.529170 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5081442f-8009-4748-8fd3-acfd3d3e4e10 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:17.699341 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-5081442f-8009-4748-8fd3-acfd3d3e4e10 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f931e726872474dae2b7b6fbb0eb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7bf59244bc487b84c7dbf9aa7314d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:25:17.709017 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-5081442f-8009-4748-8fd3-acfd3d3e4e10 tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] 10.222.0.61 "GET /compute/v2.1/servers/4e641be3-227d-43c1-aa50-ecf2b89529c9" status: 200 len: 1513 microversion: 2.1 time: 0.196492 Aug 27 02:25:17.709771 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 330/671] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:25:17 2022] GET /compute/v2.1/servers/4e641be3-227d-43c1-aa50-ecf2b89529c9 => generated 1513 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:25:18.731217 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-957533be-68c1-4486-80fa-8ad26d6f1dfe tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:25:18.731876 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-957533be-68c1-4486-80fa-8ad26d6f1dfe tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] [instance: 4e641be3-227d-43c1-aa50-ecf2b89529c9] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:25:18.739264 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-957533be-68c1-4486-80fa-8ad26d6f1dfe tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:18.739838 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-957533be-68c1-4486-80fa-8ad26d6f1dfe tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:18.740343 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-957533be-68c1-4486-80fa-8ad26d6f1dfe tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:18.741140 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-957533be-68c1-4486-80fa-8ad26d6f1dfe tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:18.741692 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-957533be-68c1-4486-80fa-8ad26d6f1dfe tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:18.742161 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-957533be-68c1-4486-80fa-8ad26d6f1dfe tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:18.892327 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-957533be-68c1-4486-80fa-8ad26d6f1dfe tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f931e726872474dae2b7b6fbb0eb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7bf59244bc487b84c7dbf9aa7314d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:25:18.901016 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-957533be-68c1-4486-80fa-8ad26d6f1dfe tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] 10.222.0.61 "GET /compute/v2.1/servers/4e641be3-227d-43c1-aa50-ecf2b89529c9" status: 200 len: 1513 microversion: 2.1 time: 0.173891 Aug 27 02:25:18.901636 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 342/672] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:25:18 2022] GET /compute/v2.1/servers/4e641be3-227d-43c1-aa50-ecf2b89529c9 => generated 1513 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:25:19.681540 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [req-19d3d1e7-379c-4fb6-ab28-aabe08745fe7 req-e135eea2-3e1f-43eb-bfd5-0124edb8e05b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e641be3-227d-43c1-aa50-ecf2b89529c9", "name": "network-vif-deleted", "tag": "6b558a7b-08bb-43cd-9d97-fbc18a195403"}]} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:25:19.694932 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-19d3d1e7-379c-4fb6-ab28-aabe08745fe7 req-e135eea2-3e1f-43eb-bfd5-0124edb8e05b service nova] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:19.695526 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-19d3d1e7-379c-4fb6-ab28-aabe08745fe7 req-e135eea2-3e1f-43eb-bfd5-0124edb8e05b service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:19.695951 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-19d3d1e7-379c-4fb6-ab28-aabe08745fe7 req-e135eea2-3e1f-43eb-bfd5-0124edb8e05b service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:19.710054 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.compute.server_external_events [req-19d3d1e7-379c-4fb6-ab28-aabe08745fe7 req-e135eea2-3e1f-43eb-bfd5-0124edb8e05b service nova] Creating event network-vif-deleted:6b558a7b-08bb-43cd-9d97-fbc18a195403 for instance 4e641be3-227d-43c1-aa50-ecf2b89529c9 on hv-cinder-84630 Aug 27 02:25:19.717910 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [req-19d3d1e7-379c-4fb6-ab28-aabe08745fe7 req-e135eea2-3e1f-43eb-bfd5-0124edb8e05b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039387 Aug 27 02:25:19.718945 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 331/673] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Aug 27 02:25:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:25:19.937865 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-0cbab28f-e1cd-45f2-8c1d-26a838e6c31d tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:25:19.938942 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-0cbab28f-e1cd-45f2-8c1d-26a838e6c31d tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] [instance: 4e641be3-227d-43c1-aa50-ecf2b89529c9] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:25:19.942829 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:25:19.952856 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0cbab28f-e1cd-45f2-8c1d-26a838e6c31d tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:19.953563 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0cbab28f-e1cd-45f2-8c1d-26a838e6c31d tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:19.954123 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0cbab28f-e1cd-45f2-8c1d-26a838e6c31d tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:19.955136 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0cbab28f-e1cd-45f2-8c1d-26a838e6c31d tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:19.955814 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0cbab28f-e1cd-45f2-8c1d-26a838e6c31d tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:19.956510 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0cbab28f-e1cd-45f2-8c1d-26a838e6c31d tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:20.003738 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0cbab28f-e1cd-45f2-8c1d-26a838e6c31d tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:20.004193 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0cbab28f-e1cd-45f2-8c1d-26a838e6c31d tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:20.004649 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0cbab28f-e1cd-45f2-8c1d-26a838e6c31d tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:20.005334 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.objects.instance [None req-0cbab28f-e1cd-45f2-8c1d-26a838e6c31d tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lazy-loading 'fault' on Instance uuid 4e641be3-227d-43c1-aa50-ecf2b89529c9 {{(pid=120782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:25:20.051349 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-0cbab28f-e1cd-45f2-8c1d-26a838e6c31d tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f931e726872474dae2b7b6fbb0eb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7bf59244bc487b84c7dbf9aa7314d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:25:20.065100 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-0cbab28f-e1cd-45f2-8c1d-26a838e6c31d tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] 10.222.0.61 "GET /compute/v2.1/servers/4e641be3-227d-43c1-aa50-ecf2b89529c9" status: 200 len: 1309 microversion: 2.1 time: 0.134583 Aug 27 02:25:20.066117 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 343/674] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:25:19 2022] GET /compute/v2.1/servers/4e641be3-227d-43c1-aa50-ecf2b89529c9 => generated 1309 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:25:20.882824 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-85b27eeb-ae9f-4e6d-a426-9e93a6a52baa tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:25:20.883442 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-85b27eeb-ae9f-4e6d-a426-9e93a6a52baa tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:25:20.892161 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-85b27eeb-ae9f-4e6d-a426-9e93a6a52baa tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:20.892693 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-85b27eeb-ae9f-4e6d-a426-9e93a6a52baa tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:20.893433 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-85b27eeb-ae9f-4e6d-a426-9e93a6a52baa tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:20.893998 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-85b27eeb-ae9f-4e6d-a426-9e93a6a52baa tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:20.894574 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-85b27eeb-ae9f-4e6d-a426-9e93a6a52baa tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:20.895029 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-85b27eeb-ae9f-4e6d-a426-9e93a6a52baa tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:20.927929 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-85b27eeb-ae9f-4e6d-a426-9e93a6a52baa tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db/os-volume_attachments/34216252-16ba-47d1-abc4-77b784e6b96c" status: 200 len: 194 microversion: 2.20 time: 0.049500 Aug 27 02:25:20.928496 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 332/675] 10.222.0.61 () {60 vars in 1454 bytes} [Sat Aug 27 02:25:20 2022] GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db/os-volume_attachments/34216252-16ba-47d1-abc4-77b784e6b96c => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:25:21.003431 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-fb02b09f-11ad-42ec-b2d8-b5ebfe0c16a8 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:25:21.004276 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-fb02b09f-11ad-42ec-b2d8-b5ebfe0c16a8 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:25:21.011799 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fb02b09f-11ad-42ec-b2d8-b5ebfe0c16a8 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:21.012315 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fb02b09f-11ad-42ec-b2d8-b5ebfe0c16a8 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:21.012787 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fb02b09f-11ad-42ec-b2d8-b5ebfe0c16a8 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:21.013558 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fb02b09f-11ad-42ec-b2d8-b5ebfe0c16a8 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:21.014047 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fb02b09f-11ad-42ec-b2d8-b5ebfe0c16a8 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:21.014501 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fb02b09f-11ad-42ec-b2d8-b5ebfe0c16a8 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:21.090034 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-e36b7cd3-2755-46f9-8604-02e483b2deff tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:25:21.090797 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-e36b7cd3-2755-46f9-8604-02e483b2deff tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] [instance: 4e641be3-227d-43c1-aa50-ecf2b89529c9] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:25:21.100462 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e36b7cd3-2755-46f9-8604-02e483b2deff tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:21.101343 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e36b7cd3-2755-46f9-8604-02e483b2deff tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:21.102046 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e36b7cd3-2755-46f9-8604-02e483b2deff tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:21.103498 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e36b7cd3-2755-46f9-8604-02e483b2deff tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:21.104467 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e36b7cd3-2755-46f9-8604-02e483b2deff tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:21.105142 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e36b7cd3-2755-46f9-8604-02e483b2deff tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:21.108027 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.objects.instance [None req-fb02b09f-11ad-42ec-b2d8-b5ebfe0c16a8 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lazy-loading 'services' on Instance uuid 47d706cc-4f9b-4d59-8eca-caae165ec5db {{(pid=120782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:25:21.123977 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.wsgi [None req-e36b7cd3-2755-46f9-8604-02e483b2deff tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] HTTP exception thrown: Instance 4e641be3-227d-43c1-aa50-ecf2b89529c9 could not be found. Aug 27 02:25:21.125863 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-e36b7cd3-2755-46f9-8604-02e483b2deff tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Request method failure captured: Aug 27 02:25:21.125863 dv-cinder-846303-3-smb devstack@n-api.service[120783]: request: GET /compute/v2.1/servers/4e641be3-227d-43c1-aa50-ecf2b89529c9 HTTP/1.1 Aug 27 02:25:21.125863 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Accept: application/json Aug 27 02:25:21.125863 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Accept-Encoding: identity Aug 27 02:25:21.125863 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Connection: close Aug 27 02:25:21.125863 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Content-Length: 0 Aug 27 02:25:21.125863 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Content-Type: application/json Aug 27 02:25:21.125863 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Host: 10.222.0.61 Aug 27 02:25:21.125863 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Openstack-System-Scope: None Aug 27 02:25:21.125863 dv-cinder-846303-3-smb devstack@n-api.service[120783]: User-Agent: python-urllib3/1.26.11 Aug 27 02:25:21.125863 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Auth-Token: gAAAAABjCX_fjcetv72At26kP1f-v082BhCSV5xlgZbXaPuJ8EYS8H090atd1ocKfAnmKo6n0RNNhFO8b3j2gmx8cG6J2zkjCmp2ZE5hEaSDdn8UUl_V-aNZ3y1z9t3z0VzgiXYt_W8fFtXoo7oturyK69Z4elR4sTNkcI86gzf6gURUnIA8Kic Aug 27 02:25:21.125863 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Domain-Id: None Aug 27 02:25:21.125863 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Domain-Name: None Aug 27 02:25:21.125863 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Identity-Status: Confirmed Aug 27 02:25:21.125863 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Is-Admin-Project: True Aug 27 02:25:21.125863 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Project-Domain-Id: default Aug 27 02:25:21.125863 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Project-Domain-Name: Default Aug 27 02:25:21.125863 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Project-Id: ac7bf59244bc487b84c7dbf9aa7314d2 Aug 27 02:25:21.125863 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1467510534 Aug 27 02:25:21.125863 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Role: member,reader Aug 27 02:25:21.125863 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Roles: member,reader Aug 27 02:25:21.128650 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ac7bf59244bc487b84c7dbf9aa7314d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ac7bf59244bc487b84c7dbf9aa7314d2", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ac7bf59244bc487b84c7dbf9aa7314d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ac7bf59244bc487b84c7dbf9aa7314d2"}]}] Aug 27 02:25:21.128650 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Tenant: tempest-VolumesSnapshotTestJSON-1467510534 Aug 27 02:25:21.128650 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Tenant-Id: ac7bf59244bc487b84c7dbf9aa7314d2 Aug 27 02:25:21.128650 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1467510534 Aug 27 02:25:21.128650 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User: tempest-VolumesSnapshotTestJSON-1467510534-project Aug 27 02:25:21.128650 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User-Domain-Id: default Aug 27 02:25:21.128650 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User-Domain-Name: Default Aug 27 02:25:21.128650 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User-Id: 2f931e726872474dae2b7b6fbb0eb644 Aug 27 02:25:21.128650 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User-Name: tempest-VolumesSnapshotTestJSON-1467510534-project Aug 27 02:25:21.128650 dv-cinder-846303-3-smb devstack@n-api.service[120783]: method: > Aug 27 02:25:21.128650 dv-cinder-846303-3-smb devstack@n-api.service[120783]: exception: Instance 4e641be3-227d-43c1-aa50-ecf2b89529c9 could not be found. Aug 27 02:25:21.128650 dv-cinder-846303-3-smb devstack@n-api.service[120783]: action_args: {'id': '4e641be3-227d-43c1-aa50-ecf2b89529c9'} Aug 27 02:25:21.130281 dv-cinder-846303-3-smb devstack@n-api.service[120783]: {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:25:21.130281 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:25:21.130281 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:25:21.130281 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:25:21.130281 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:25:21.130281 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:25:21.130281 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:25:21.130281 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:25:21.130281 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:25:21.130281 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:25:21.130281 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e641be3-227d-43c1-aa50-ecf2b89529c9 could not be found. Aug 27 02:25:21.130281 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:25:21.130281 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:25:21.130281 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:25:21.130281 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:25:21.130281 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:25:21.130281 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:25:21.130281 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:25:21.130281 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:25:21.130281 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:25:21.133177 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:25:21.133177 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:25:21.133177 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:25:21.133177 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:25:21.133177 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:25:21.133177 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:25:21.133177 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:25:21.133177 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e641be3-227d-43c1-aa50-ecf2b89529c9 could not be found. Aug 27 02:25:21.133177 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:25:21.133177 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:25:21.133177 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:25:21.133177 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:25:21.133177 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:25:21.133177 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:25:21.133177 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:25:21.133177 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:25:21.133177 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e641be3-227d-43c1-aa50-ecf2b89529c9 could not be found. Aug 27 02:25:21.133177 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:25:21.135172 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-e36b7cd3-2755-46f9-8604-02e483b2deff tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] Returning 404 to user: Instance 4e641be3-227d-43c1-aa50-ecf2b89529c9 could not be found. {{(pid=120783) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:25:21.135172 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-e36b7cd3-2755-46f9-8604-02e483b2deff tempest-VolumesSnapshotTestJSON-1467510534 tempest-VolumesSnapshotTestJSON-1467510534-project] 10.222.0.61 "GET /compute/v2.1/servers/4e641be3-227d-43c1-aa50-ecf2b89529c9" status: 404 len: 111 microversion: 2.1 time: 0.041921 Aug 27 02:25:21.135172 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 333/676] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:25:21 2022] GET /compute/v2.1/servers/4e641be3-227d-43c1-aa50-ecf2b89529c9 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 02:25:21.207278 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-fb02b09f-11ad-42ec-b2d8-b5ebfe0c16a8 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "DELETE /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db/os-volume_attachments/34216252-16ba-47d1-abc4-77b784e6b96c" status: 202 len: 0 microversion: 2.20 time: 0.208069 Aug 27 02:25:21.208629 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 344/677] 10.222.0.61 () {60 vars in 1457 bytes} [Sat Aug 27 02:25:20 2022] DELETE /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db/os-volume_attachments/34216252-16ba-47d1-abc4-77b784e6b96c => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 27 02:25:21.222739 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-84186dc5-2fb6-4212-ba7c-a313d876c23a tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:25:21.226980 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-84186dc5-2fb6-4212-ba7c-a313d876c23a tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:25:21.237506 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-07e7a483-a62a-464b-ae73-6be12993b5b3 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:25:21.240042 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-84186dc5-2fb6-4212-ba7c-a313d876c23a tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:21.241467 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-84186dc5-2fb6-4212-ba7c-a313d876c23a tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:21.242153 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-07e7a483-a62a-464b-ae73-6be12993b5b3 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] [instance: 49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:25:21.243224 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-84186dc5-2fb6-4212-ba7c-a313d876c23a tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:21.245488 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-84186dc5-2fb6-4212-ba7c-a313d876c23a tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:21.246565 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-84186dc5-2fb6-4212-ba7c-a313d876c23a tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:21.247519 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-84186dc5-2fb6-4212-ba7c-a313d876c23a tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:21.252460 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-07e7a483-a62a-464b-ae73-6be12993b5b3 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:21.253285 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-07e7a483-a62a-464b-ae73-6be12993b5b3 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:21.253933 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-07e7a483-a62a-464b-ae73-6be12993b5b3 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:21.254897 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-07e7a483-a62a-464b-ae73-6be12993b5b3 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:21.255482 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-07e7a483-a62a-464b-ae73-6be12993b5b3 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:21.255997 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-07e7a483-a62a-464b-ae73-6be12993b5b3 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:21.311473 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-84186dc5-2fb6-4212-ba7c-a313d876c23a tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.095986 Aug 27 02:25:21.313259 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 334/678] 10.222.0.61 () {60 vars in 1343 bytes} [Sat Aug 27 02:25:21 2022] GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 02:25:21.390699 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-07e7a483-a62a-464b-ae73-6be12993b5b3 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] 10.222.0.61 "POST /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8/action" status: 202 len: 0 microversion: 2.1 time: 0.160746 Aug 27 02:25:21.391876 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 345/679] 10.222.0.61 () {60 vars in 1278 bytes} [Sat Aug 27 02:25:21 2022] POST /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8/action => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:25:21.406394 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-1db87377-904d-43c8-a8a5-2206c21e8ac9 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:25:21.408037 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-1db87377-904d-43c8-a8a5-2206c21e8ac9 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] [instance: 49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:25:21.420357 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1db87377-904d-43c8-a8a5-2206c21e8ac9 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:21.421358 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1db87377-904d-43c8-a8a5-2206c21e8ac9 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:21.422553 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1db87377-904d-43c8-a8a5-2206c21e8ac9 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:21.424000 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1db87377-904d-43c8-a8a5-2206c21e8ac9 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:21.425037 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1db87377-904d-43c8-a8a5-2206c21e8ac9 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:21.426007 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1db87377-904d-43c8-a8a5-2206c21e8ac9 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:21.662289 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-1db87377-904d-43c8-a8a5-2206c21e8ac9 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931dcabba0214e3daa878f31cd1706cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f956d4d27437c830871f6634a3018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:25:21.671423 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-1db87377-904d-43c8-a8a5-2206c21e8ac9 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] 10.222.0.61 "GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8" status: 200 len: 1750 microversion: 2.1 time: 0.272964 Aug 27 02:25:21.672081 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 335/680] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:25:21 2022] GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8 => generated 1750 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:25:22.335182 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-26948312-8bfa-4a92-a55f-8e8009c5a3d6 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:25:22.338905 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-26948312-8bfa-4a92-a55f-8e8009c5a3d6 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:25:22.351712 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-26948312-8bfa-4a92-a55f-8e8009c5a3d6 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:22.353046 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-26948312-8bfa-4a92-a55f-8e8009c5a3d6 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:22.354025 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-26948312-8bfa-4a92-a55f-8e8009c5a3d6 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:22.355790 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-26948312-8bfa-4a92-a55f-8e8009c5a3d6 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:22.356618 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-26948312-8bfa-4a92-a55f-8e8009c5a3d6 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:22.357638 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-26948312-8bfa-4a92-a55f-8e8009c5a3d6 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:22.363017 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:25:22.399547 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-26948312-8bfa-4a92-a55f-8e8009c5a3d6 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.073254 Aug 27 02:25:22.400433 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 346/681] 10.222.0.61 () {60 vars in 1343 bytes} [Sat Aug 27 02:25:22 2022] GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 02:25:22.704113 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-4fb502af-816b-4d44-8fad-cbe610eb3a92 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:25:22.705117 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-4fb502af-816b-4d44-8fad-cbe610eb3a92 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] [instance: 49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:25:22.718656 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4fb502af-816b-4d44-8fad-cbe610eb3a92 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:22.719509 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4fb502af-816b-4d44-8fad-cbe610eb3a92 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:22.720057 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4fb502af-816b-4d44-8fad-cbe610eb3a92 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:22.720881 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4fb502af-816b-4d44-8fad-cbe610eb3a92 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:22.721674 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4fb502af-816b-4d44-8fad-cbe610eb3a92 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:22.722194 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4fb502af-816b-4d44-8fad-cbe610eb3a92 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:22.940580 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-4fb502af-816b-4d44-8fad-cbe610eb3a92 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931dcabba0214e3daa878f31cd1706cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f956d4d27437c830871f6634a3018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:25:22.940809 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-4fb502af-816b-4d44-8fad-cbe610eb3a92 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] 10.222.0.61 "GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8" status: 200 len: 1750 microversion: 2.1 time: 0.240867 Aug 27 02:25:22.941386 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 336/682] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:25:22 2022] GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8 => generated 1750 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:25:23.415738 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-d12ba0a5-df40-48df-9b06-18c05aa36b64 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:25:23.417886 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-d12ba0a5-df40-48df-9b06-18c05aa36b64 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:25:23.424932 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d12ba0a5-df40-48df-9b06-18c05aa36b64 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:23.425437 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d12ba0a5-df40-48df-9b06-18c05aa36b64 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:23.425868 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d12ba0a5-df40-48df-9b06-18c05aa36b64 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:23.426566 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d12ba0a5-df40-48df-9b06-18c05aa36b64 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:23.427012 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d12ba0a5-df40-48df-9b06-18c05aa36b64 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:23.427432 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d12ba0a5-df40-48df-9b06-18c05aa36b64 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:23.461739 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-d12ba0a5-df40-48df-9b06-18c05aa36b64 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049883 Aug 27 02:25:23.462346 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 347/683] 10.222.0.61 () {60 vars in 1343 bytes} [Sat Aug 27 02:25:23 2022] GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:25:23.532343 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-46c23081-d6d3-42fb-b278-3a6100f7c910 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:25:23.532835 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-46c23081-d6d3-42fb-b278-3a6100f7c910 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:25:23.545974 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-46c23081-d6d3-42fb-b278-3a6100f7c910 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:23.546468 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-46c23081-d6d3-42fb-b278-3a6100f7c910 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:23.546881 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-46c23081-d6d3-42fb-b278-3a6100f7c910 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:23.547626 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-46c23081-d6d3-42fb-b278-3a6100f7c910 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:23.548084 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-46c23081-d6d3-42fb-b278-3a6100f7c910 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:23.548505 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-46c23081-d6d3-42fb-b278-3a6100f7c910 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:23.577184 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-46c23081-d6d3-42fb-b278-3a6100f7c910 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Going to try to terminate instance {{(pid=120783) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:25:23.671002 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-46c23081-d6d3-42fb-b278-3a6100f7c910 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "DELETE /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db" status: 204 len: 0 microversion: 2.20 time: 0.142087 Aug 27 02:25:23.672045 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 337/684] 10.222.0.61 () {60 vars in 1280 bytes} [Sat Aug 27 02:25:23 2022] DELETE /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 02:25:23.684599 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-4969ec6d-4c31-48b5-9460-4ca1d6bb1385 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:25:23.685931 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-4969ec6d-4c31-48b5-9460-4ca1d6bb1385 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:25:23.698555 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4969ec6d-4c31-48b5-9460-4ca1d6bb1385 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:23.699402 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4969ec6d-4c31-48b5-9460-4ca1d6bb1385 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:23.700193 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4969ec6d-4c31-48b5-9460-4ca1d6bb1385 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:23.701038 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4969ec6d-4c31-48b5-9460-4ca1d6bb1385 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:23.701857 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4969ec6d-4c31-48b5-9460-4ca1d6bb1385 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:23.702636 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4969ec6d-4c31-48b5-9460-4ca1d6bb1385 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:23.854954 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-4969ec6d-4c31-48b5-9460-4ca1d6bb1385 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:25:23.864272 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-4969ec6d-4c31-48b5-9460-4ca1d6bb1385 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:25:23.865817 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-4969ec6d-4c31-48b5-9460-4ca1d6bb1385 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:25:23.867014 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-4969ec6d-4c31-48b5-9460-4ca1d6bb1385 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db" status: 200 len: 1722 microversion: 2.20 time: 0.190101 Aug 27 02:25:23.867578 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 348/685] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:25:23 2022] GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db => generated 1722 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:25:23.964279 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-10d61eab-6f9b-41df-b57c-1b05da0b4788 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:25:23.965600 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-10d61eab-6f9b-41df-b57c-1b05da0b4788 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] [instance: 49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:25:23.973168 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-10d61eab-6f9b-41df-b57c-1b05da0b4788 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:23.973711 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-10d61eab-6f9b-41df-b57c-1b05da0b4788 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:23.974149 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-10d61eab-6f9b-41df-b57c-1b05da0b4788 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:23.974858 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-10d61eab-6f9b-41df-b57c-1b05da0b4788 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:23.975458 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-10d61eab-6f9b-41df-b57c-1b05da0b4788 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:23.975888 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-10d61eab-6f9b-41df-b57c-1b05da0b4788 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:23.982162 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:25:24.142483 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-10d61eab-6f9b-41df-b57c-1b05da0b4788 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931dcabba0214e3daa878f31cd1706cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f956d4d27437c830871f6634a3018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:25:24.157669 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-10d61eab-6f9b-41df-b57c-1b05da0b4788 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] 10.222.0.61 "GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8" status: 200 len: 1755 microversion: 2.1 time: 0.197923 Aug 27 02:25:24.158426 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 338/686] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:25:23 2022] GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8 => generated 1755 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:25:24.892412 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-5f6e0123-df8a-4f37-a2fc-b2a2030f0c4b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:25:24.893705 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-5f6e0123-df8a-4f37-a2fc-b2a2030f0c4b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:25:24.901216 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5f6e0123-df8a-4f37-a2fc-b2a2030f0c4b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:24.901776 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5f6e0123-df8a-4f37-a2fc-b2a2030f0c4b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:24.902289 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5f6e0123-df8a-4f37-a2fc-b2a2030f0c4b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:24.903050 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5f6e0123-df8a-4f37-a2fc-b2a2030f0c4b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:24.903540 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5f6e0123-df8a-4f37-a2fc-b2a2030f0c4b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:24.904042 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5f6e0123-df8a-4f37-a2fc-b2a2030f0c4b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:25.055920 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-5f6e0123-df8a-4f37-a2fc-b2a2030f0c4b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:25:25.070747 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-5f6e0123-df8a-4f37-a2fc-b2a2030f0c4b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:25:25.073577 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-5f6e0123-df8a-4f37-a2fc-b2a2030f0c4b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:25:25.075923 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-5f6e0123-df8a-4f37-a2fc-b2a2030f0c4b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db" status: 200 len: 1722 microversion: 2.20 time: 0.187574 Aug 27 02:25:25.076910 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 349/687] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:25:24 2022] GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db => generated 1722 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:25:25.192441 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-7187a6aa-40c9-4934-962a-0e54128731fc tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:25:25.193033 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-7187a6aa-40c9-4934-962a-0e54128731fc tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] [instance: 49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:25:25.200680 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7187a6aa-40c9-4934-962a-0e54128731fc tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:25.201157 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7187a6aa-40c9-4934-962a-0e54128731fc tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:25.201827 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7187a6aa-40c9-4934-962a-0e54128731fc tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:25.202643 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7187a6aa-40c9-4934-962a-0e54128731fc tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:25.203146 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7187a6aa-40c9-4934-962a-0e54128731fc tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:25.203645 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7187a6aa-40c9-4934-962a-0e54128731fc tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:25.390667 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-7187a6aa-40c9-4934-962a-0e54128731fc tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931dcabba0214e3daa878f31cd1706cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f956d4d27437c830871f6634a3018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:25:25.400051 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-7187a6aa-40c9-4934-962a-0e54128731fc tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] 10.222.0.61 "GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8" status: 200 len: 1755 microversion: 2.1 time: 0.211759 Aug 27 02:25:25.400638 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 339/688] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:25:25 2022] GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8 => generated 1755 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:25:26.100662 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-a9d9c906-4452-4c2e-8808-b3e0352f92eb tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:25:26.101595 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-a9d9c906-4452-4c2e-8808-b3e0352f92eb tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:25:26.108228 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a9d9c906-4452-4c2e-8808-b3e0352f92eb tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:26.108789 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a9d9c906-4452-4c2e-8808-b3e0352f92eb tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:26.109272 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a9d9c906-4452-4c2e-8808-b3e0352f92eb tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:26.110011 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a9d9c906-4452-4c2e-8808-b3e0352f92eb tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:26.110470 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a9d9c906-4452-4c2e-8808-b3e0352f92eb tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:26.110892 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a9d9c906-4452-4c2e-8808-b3e0352f92eb tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:26.266161 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-a9d9c906-4452-4c2e-8808-b3e0352f92eb tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:25:26.281282 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-a9d9c906-4452-4c2e-8808-b3e0352f92eb tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:25:26.284213 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-a9d9c906-4452-4c2e-8808-b3e0352f92eb tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:25:26.286377 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-a9d9c906-4452-4c2e-8808-b3e0352f92eb tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db" status: 200 len: 1722 microversion: 2.20 time: 0.189614 Aug 27 02:25:26.287422 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 350/689] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:25:26 2022] GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db => generated 1722 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:25:26.437350 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-2c01b697-95f1-40f7-832b-d295f2166e68 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:25:26.438641 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-2c01b697-95f1-40f7-832b-d295f2166e68 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] [instance: 49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:25:26.448343 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2c01b697-95f1-40f7-832b-d295f2166e68 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:26.448883 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2c01b697-95f1-40f7-832b-d295f2166e68 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:26.449318 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2c01b697-95f1-40f7-832b-d295f2166e68 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:26.450099 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2c01b697-95f1-40f7-832b-d295f2166e68 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:26.450559 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2c01b697-95f1-40f7-832b-d295f2166e68 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:26.450984 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2c01b697-95f1-40f7-832b-d295f2166e68 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:26.813450 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-2c01b697-95f1-40f7-832b-d295f2166e68 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931dcabba0214e3daa878f31cd1706cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f956d4d27437c830871f6634a3018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:25:26.829203 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-2c01b697-95f1-40f7-832b-d295f2166e68 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] 10.222.0.61 "GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8" status: 200 len: 1755 microversion: 2.1 time: 0.397909 Aug 27 02:25:26.830576 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 340/690] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:25:26 2022] GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8 => generated 1755 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:25:27.317178 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-b26d190b-ed3d-40cf-acc3-27a49c4c404b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:25:27.317989 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-b26d190b-ed3d-40cf-acc3-27a49c4c404b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:25:27.329350 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b26d190b-ed3d-40cf-acc3-27a49c4c404b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:27.329870 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b26d190b-ed3d-40cf-acc3-27a49c4c404b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:27.330307 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b26d190b-ed3d-40cf-acc3-27a49c4c404b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:27.331023 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b26d190b-ed3d-40cf-acc3-27a49c4c404b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:27.331474 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b26d190b-ed3d-40cf-acc3-27a49c4c404b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:27.331897 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b26d190b-ed3d-40cf-acc3-27a49c4c404b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:27.433479 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-b26d190b-ed3d-40cf-acc3-27a49c4c404b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:25:27.450003 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-b26d190b-ed3d-40cf-acc3-27a49c4c404b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:25:27.451492 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-b26d190b-ed3d-40cf-acc3-27a49c4c404b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:25:27.452975 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-b26d190b-ed3d-40cf-acc3-27a49c4c404b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db" status: 200 len: 1655 microversion: 2.20 time: 0.139963 Aug 27 02:25:27.453625 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 351/691] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:25:27 2022] GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db => generated 1655 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:25:27.800988 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [req-433b0bb6-837d-40ce-906c-321d1a072f78 req-dbaf0505-f1ae-405f-b614-0332119e877c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47d706cc-4f9b-4d59-8eca-caae165ec5db", "name": "network-vif-deleted", "tag": "118e8d55-f026-4cab-95af-2825721ac127"}]} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:25:27.808012 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:25:27.815416 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-433b0bb6-837d-40ce-906c-321d1a072f78 req-dbaf0505-f1ae-405f-b614-0332119e877c service nova] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:27.815905 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-433b0bb6-837d-40ce-906c-321d1a072f78 req-dbaf0505-f1ae-405f-b614-0332119e877c service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:27.816332 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-433b0bb6-837d-40ce-906c-321d1a072f78 req-dbaf0505-f1ae-405f-b614-0332119e877c service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:27.829277 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.compute.server_external_events [req-433b0bb6-837d-40ce-906c-321d1a072f78 req-dbaf0505-f1ae-405f-b614-0332119e877c service nova] Creating event network-vif-deleted:118e8d55-f026-4cab-95af-2825721ac127 for instance 47d706cc-4f9b-4d59-8eca-caae165ec5db on hv-cinder-84630 Aug 27 02:25:27.834889 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [req-433b0bb6-837d-40ce-906c-321d1a072f78 req-dbaf0505-f1ae-405f-b614-0332119e877c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039703 Aug 27 02:25:27.835501 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 341/692] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Aug 27 02:25:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:25:27.868616 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-3fe45311-12bb-4c30-9226-a0e987212285 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:25:27.869529 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-3fe45311-12bb-4c30-9226-a0e987212285 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] [instance: 49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:25:27.876610 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3fe45311-12bb-4c30-9226-a0e987212285 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:27.877385 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3fe45311-12bb-4c30-9226-a0e987212285 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:27.878019 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3fe45311-12bb-4c30-9226-a0e987212285 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:27.878934 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3fe45311-12bb-4c30-9226-a0e987212285 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:27.879555 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3fe45311-12bb-4c30-9226-a0e987212285 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:27.879823 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3fe45311-12bb-4c30-9226-a0e987212285 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:28.325953 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-3fe45311-12bb-4c30-9226-a0e987212285 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931dcabba0214e3daa878f31cd1706cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f956d4d27437c830871f6634a3018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:25:28.338123 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-3fe45311-12bb-4c30-9226-a0e987212285 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] 10.222.0.61 "GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8" status: 200 len: 1755 microversion: 2.1 time: 0.473157 Aug 27 02:25:28.341483 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 352/693] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:25:27 2022] GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8 => generated 1755 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:25:28.478941 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-2b335ad5-20b8-49e1-872f-c4874bc64e71 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:25:28.479640 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-2b335ad5-20b8-49e1-872f-c4874bc64e71 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:25:28.487227 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2b335ad5-20b8-49e1-872f-c4874bc64e71 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:28.488012 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2b335ad5-20b8-49e1-872f-c4874bc64e71 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:28.488445 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2b335ad5-20b8-49e1-872f-c4874bc64e71 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:28.489341 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2b335ad5-20b8-49e1-872f-c4874bc64e71 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:28.489854 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2b335ad5-20b8-49e1-872f-c4874bc64e71 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:28.490273 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2b335ad5-20b8-49e1-872f-c4874bc64e71 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:28.532278 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2b335ad5-20b8-49e1-872f-c4874bc64e71 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:28.533053 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2b335ad5-20b8-49e1-872f-c4874bc64e71 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:28.533530 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2b335ad5-20b8-49e1-872f-c4874bc64e71 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:28.534352 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.objects.instance [None req-2b335ad5-20b8-49e1-872f-c4874bc64e71 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lazy-loading 'fault' on Instance uuid 47d706cc-4f9b-4d59-8eca-caae165ec5db {{(pid=120783) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:25:28.584811 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-2b335ad5-20b8-49e1-872f-c4874bc64e71 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:25:28.597123 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-2b335ad5-20b8-49e1-872f-c4874bc64e71 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:25:28.598832 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-2b335ad5-20b8-49e1-872f-c4874bc64e71 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:25:28.600081 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-2b335ad5-20b8-49e1-872f-c4874bc64e71 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db" status: 200 len: 1372 microversion: 2.20 time: 0.126238 Aug 27 02:25:28.601028 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 342/694] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:25:28 2022] GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db => generated 1372 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:25:29.360675 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-03dcb06a-86eb-4e4a-8832-5a6596d3be79 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:25:29.361270 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-03dcb06a-86eb-4e4a-8832-5a6596d3be79 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] [instance: 49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:25:29.368313 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-03dcb06a-86eb-4e4a-8832-5a6596d3be79 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:29.368799 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-03dcb06a-86eb-4e4a-8832-5a6596d3be79 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:29.369255 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-03dcb06a-86eb-4e4a-8832-5a6596d3be79 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:29.369982 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-03dcb06a-86eb-4e4a-8832-5a6596d3be79 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:29.370432 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-03dcb06a-86eb-4e4a-8832-5a6596d3be79 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:29.370850 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-03dcb06a-86eb-4e4a-8832-5a6596d3be79 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:29.523560 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-03dcb06a-86eb-4e4a-8832-5a6596d3be79 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931dcabba0214e3daa878f31cd1706cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f956d4d27437c830871f6634a3018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:25:29.532635 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-03dcb06a-86eb-4e4a-8832-5a6596d3be79 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] 10.222.0.61 "GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8" status: 200 len: 1755 microversion: 2.1 time: 0.175971 Aug 27 02:25:29.533206 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 353/695] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:25:29 2022] GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8 => generated 1755 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:25:29.625341 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-2b7743d1-fe07-4da6-a9d0-6e3a3ab5b35c tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:25:29.626234 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-2b7743d1-fe07-4da6-a9d0-6e3a3ab5b35c tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:25:29.634201 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2b7743d1-fe07-4da6-a9d0-6e3a3ab5b35c tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:29.634879 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2b7743d1-fe07-4da6-a9d0-6e3a3ab5b35c tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:29.635785 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2b7743d1-fe07-4da6-a9d0-6e3a3ab5b35c tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:29.636639 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2b7743d1-fe07-4da6-a9d0-6e3a3ab5b35c tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:29.637762 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2b7743d1-fe07-4da6-a9d0-6e3a3ab5b35c tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:29.638423 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2b7743d1-fe07-4da6-a9d0-6e3a3ab5b35c tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:29.655345 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.wsgi [None req-2b7743d1-fe07-4da6-a9d0-6e3a3ab5b35c tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] HTTP exception thrown: Instance 47d706cc-4f9b-4d59-8eca-caae165ec5db could not be found. Aug 27 02:25:29.657032 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-2b7743d1-fe07-4da6-a9d0-6e3a3ab5b35c tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Request method failure captured: Aug 27 02:25:29.657032 dv-cinder-846303-3-smb devstack@n-api.service[120783]: request: GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db HTTP/1.1 Aug 27 02:25:29.657032 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Accept: application/json Aug 27 02:25:29.657032 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Accept-Encoding: identity Aug 27 02:25:29.657032 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Connection: close Aug 27 02:25:29.657032 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Content-Length: 0 Aug 27 02:25:29.657032 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Content-Type: application/json Aug 27 02:25:29.657032 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Host: 10.222.0.61 Aug 27 02:25:29.657032 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Openstack-System-Scope: None Aug 27 02:25:29.657032 dv-cinder-846303-3-smb devstack@n-api.service[120783]: User-Agent: python-urllib3/1.26.11 Aug 27 02:25:29.657032 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Auth-Token: gAAAAABjCX-NL7PN5YuGlTifkm6bkq5aj7zAK0PJaEtfqY4JdnQh7Dc-iLBs9yrPb9ysb0HzdvfbIKz7tBDsbd8gK3YV60jxlF-7Ydr56BDh45Q4CiEorXN3T2CkeEqdbY4S1RhTmJIn1Z4W5beCdfRqyig--AFk-QiM6HrjaSEjIstgLTxSx4Q Aug 27 02:25:29.657032 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Domain-Id: None Aug 27 02:25:29.657032 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Domain-Name: None Aug 27 02:25:29.657032 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Identity-Status: Confirmed Aug 27 02:25:29.657032 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Is-Admin-Project: True Aug 27 02:25:29.657032 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Openstack-Nova-Api-Version: 2.20 Aug 27 02:25:29.657032 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Project-Domain-Id: default Aug 27 02:25:29.657032 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Project-Domain-Name: Default Aug 27 02:25:29.657032 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Project-Id: 9409824440cb45508754064b55438edd Aug 27 02:25:29.657032 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-832533989 Aug 27 02:25:29.657032 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Role: member,reader Aug 27 02:25:29.657032 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Roles: member,reader Aug 27 02:25:29.659866 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9409824440cb45508754064b55438edd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9409824440cb45508754064b55438edd", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9409824440cb45508754064b55438edd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9409824440cb45508754064b55438edd"}]}] Aug 27 02:25:29.659866 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Tenant: tempest-AttachVolumeShelveTestJSON-832533989 Aug 27 02:25:29.659866 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Tenant-Id: 9409824440cb45508754064b55438edd Aug 27 02:25:29.659866 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-832533989 Aug 27 02:25:29.659866 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User: tempest-AttachVolumeShelveTestJSON-832533989-project Aug 27 02:25:29.659866 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User-Domain-Id: default Aug 27 02:25:29.659866 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User-Domain-Name: Default Aug 27 02:25:29.659866 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User-Id: cd08f3b52004476b9eb532c7c68ab679 Aug 27 02:25:29.659866 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User-Name: tempest-AttachVolumeShelveTestJSON-832533989-project Aug 27 02:25:29.659866 dv-cinder-846303-3-smb devstack@n-api.service[120783]: method: > Aug 27 02:25:29.659866 dv-cinder-846303-3-smb devstack@n-api.service[120783]: exception: Instance 47d706cc-4f9b-4d59-8eca-caae165ec5db could not be found. Aug 27 02:25:29.659866 dv-cinder-846303-3-smb devstack@n-api.service[120783]: action_args: {'id': '47d706cc-4f9b-4d59-8eca-caae165ec5db'} Aug 27 02:25:29.661240 dv-cinder-846303-3-smb devstack@n-api.service[120783]: {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:25:29.661240 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:25:29.661240 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:25:29.661240 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:25:29.661240 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:25:29.661240 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:25:29.661240 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:25:29.661240 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:25:29.661240 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:25:29.661240 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:25:29.661240 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47d706cc-4f9b-4d59-8eca-caae165ec5db could not be found. Aug 27 02:25:29.661240 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:25:29.661240 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:25:29.661240 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:25:29.661240 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:25:29.661240 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:25:29.661240 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:25:29.661240 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:25:29.661240 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:25:29.661240 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:25:29.663045 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:25:29.663045 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:25:29.663045 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:25:29.663045 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:25:29.663045 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:25:29.663045 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:25:29.663045 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:25:29.663045 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47d706cc-4f9b-4d59-8eca-caae165ec5db could not be found. Aug 27 02:25:29.663045 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:25:29.663045 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:25:29.663045 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:25:29.663045 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:25:29.663045 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:25:29.663045 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:25:29.663045 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:25:29.663045 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:25:29.663045 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47d706cc-4f9b-4d59-8eca-caae165ec5db could not be found. Aug 27 02:25:29.663045 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:25:29.664667 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-2b7743d1-fe07-4da6-a9d0-6e3a3ab5b35c tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Returning 404 to user: Instance 47d706cc-4f9b-4d59-8eca-caae165ec5db could not be found. {{(pid=120783) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:25:29.664667 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-2b7743d1-fe07-4da6-a9d0-6e3a3ab5b35c tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db" status: 404 len: 111 microversion: 2.20 time: 0.037466 Aug 27 02:25:29.664667 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 343/696] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:25:29 2022] GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 27 02:25:29.667798 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-89fde118-31ec-48d3-bb70-6b4e167c4d53 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '.version_select at 0x7fd808479940>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:25:29.690257 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-89fde118-31ec-48d3-bb70-6b4e167c4d53 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1345816608" status: 204 len: 0 microversion: 2.20 time: 0.025632 Aug 27 02:25:29.691013 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 354/697] 10.222.0.61 () {60 vars in 1262 bytes} [Sat Aug 27 02:25:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1345816608 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 02:25:30.462493 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-47d32627-8794-46df-b51f-13dd207e147a tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Action: 'create', calling method: .version_select at 0x7fd80829cca0>, body: {"keypair": {"name": "tempest-keypair-998764215", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEhri1OA3q+G6VE5Htt/aKQo5objyqHpZNAzVfFByTsHpblDcQ1CE3GdSJSleh1Tqh7wneXKgnND5HebGUaYC6KnBb5HaLeL2SZZTs8ixrgYRqsBhO3MTjq6L6+qbQZI1Q=="}} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:25:30.478792 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.quota [None req-47d32627-8794-46df-b51f-13dd207e147a tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Getting quotas for project 9409824440cb45508754064b55438edd. Resources: {'key_pairs'} {{(pid=120783) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:25:30.483244 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.quota [None req-47d32627-8794-46df-b51f-13dd207e147a tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Getting quotas for user cd08f3b52004476b9eb532c7c68ab679 and project 9409824440cb45508754064b55438edd. Resources: {'key_pairs'} {{(pid=120783) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:25:30.507532 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-47d32627-8794-46df-b51f-13dd207e147a tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.048975 Aug 27 02:25:30.508383 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 344/698] 10.222.0.61 () {62 vars in 1200 bytes} [Sat Aug 27 02:25:30 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 51 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 27 02:25:30.567576 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-56998394-a84a-4bfa-a295-e95b9900b949 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:25:30.568151 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-56998394-a84a-4bfa-a295-e95b9900b949 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] [instance: 49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:25:30.575629 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-56998394-a84a-4bfa-a295-e95b9900b949 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:30.576110 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-56998394-a84a-4bfa-a295-e95b9900b949 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:30.576537 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-56998394-a84a-4bfa-a295-e95b9900b949 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:30.577262 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-56998394-a84a-4bfa-a295-e95b9900b949 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:30.577910 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-56998394-a84a-4bfa-a295-e95b9900b949 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:30.578332 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-56998394-a84a-4bfa-a295-e95b9900b949 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:30.835621 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-56998394-a84a-4bfa-a295-e95b9900b949 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931dcabba0214e3daa878f31cd1706cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f956d4d27437c830871f6634a3018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:25:30.845154 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-56998394-a84a-4bfa-a295-e95b9900b949 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] 10.222.0.61 "GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8" status: 200 len: 1755 microversion: 2.1 time: 0.281402 Aug 27 02:25:30.845914 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 355/699] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:25:30 2022] GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8 => generated 1755 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:25:31.866004 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-57215176-20a1-4d04-86ca-9f0cea57e1e7 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:25:31.866611 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-57215176-20a1-4d04-86ca-9f0cea57e1e7 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] [instance: 49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:25:31.874550 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-57215176-20a1-4d04-86ca-9f0cea57e1e7 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:31.875043 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-57215176-20a1-4d04-86ca-9f0cea57e1e7 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:31.875474 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-57215176-20a1-4d04-86ca-9f0cea57e1e7 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:31.876187 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-57215176-20a1-4d04-86ca-9f0cea57e1e7 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:31.876640 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-57215176-20a1-4d04-86ca-9f0cea57e1e7 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:31.877053 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-57215176-20a1-4d04-86ca-9f0cea57e1e7 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:32.094135 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-57215176-20a1-4d04-86ca-9f0cea57e1e7 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931dcabba0214e3daa878f31cd1706cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f956d4d27437c830871f6634a3018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:25:32.103179 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-57215176-20a1-4d04-86ca-9f0cea57e1e7 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] 10.222.0.61 "GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8" status: 200 len: 1755 microversion: 2.1 time: 0.241040 Aug 27 02:25:32.103766 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 345/700] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:25:31 2022] GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8 => generated 1755 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:25:32.127163 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-cb3438b2-2bbe-42b8-86be-874fc6077d44 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-533573177", "imageRef": "7d45cdd6-750f-40c7-9475-f7bf12fcb204", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c1dba08a-c583-4d5e-88a8-72a835e2f48b"}], "security_groups": [{"name": "tempest-securitygroup--2126691517"}], "key_name": "tempest-keypair-998764215", "user_data": "}} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:25:32.239390 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.network.neutron [None req-cb3438b2-2bbe-42b8-86be-874fc6077d44 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] validate_networks() for [('c1dba08a-c583-4d5e-88a8-72a835e2f48b', None, None, None, None, None)] {{(pid=120782) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:25:32.722241 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-cb3438b2-2bbe-42b8-86be-874fc6077d44 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Flavor limits 0:0:0 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:25:32.722730 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-cb3438b2-2bbe-42b8-86be-874fc6077d44 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Image limits 0:0:0 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:25:32.722873 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-cb3438b2-2bbe-42b8-86be-874fc6077d44 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Flavor pref 0:0:0 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:25:32.723291 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-cb3438b2-2bbe-42b8-86be-874fc6077d44 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Image pref 0:0:0 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:25:32.723759 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-cb3438b2-2bbe-42b8-86be-874fc6077d44 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:25:32.733954 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cb3438b2-2bbe-42b8-86be-874fc6077d44 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:32.734439 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cb3438b2-2bbe-42b8-86be-874fc6077d44 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:32.734840 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cb3438b2-2bbe-42b8-86be-874fc6077d44 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:32.735576 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cb3438b2-2bbe-42b8-86be-874fc6077d44 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:32.736148 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cb3438b2-2bbe-42b8-86be-874fc6077d44 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:32.736781 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cb3438b2-2bbe-42b8-86be-874fc6077d44 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:32.758911 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.quota [None req-cb3438b2-2bbe-42b8-86be-874fc6077d44 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Getting quotas for project 9409824440cb45508754064b55438edd. Resources: {'instances', 'ram', 'cores'} {{(pid=120782) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:25:32.763458 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.quota [None req-cb3438b2-2bbe-42b8-86be-874fc6077d44 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Getting quotas for user cd08f3b52004476b9eb532c7c68ab679 and project 9409824440cb45508754064b55438edd. Resources: {'instances', 'ram', 'cores'} {{(pid=120782) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:25:32.776320 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-cb3438b2-2bbe-42b8-86be-874fc6077d44 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Going to run 1 instances... {{(pid=120782) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:25:32.778677 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-cb3438b2-2bbe-42b8-86be-874fc6077d44 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 99f2f366-4776-427e-99cf-79399835f2c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7d45cdd6-750f-40c7-9475-f7bf12fcb204',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120782) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:25:32.828224 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-cb3438b2-2bbe-42b8-86be-874fc6077d44 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.705243 Aug 27 02:25:32.828918 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 356/701] 10.222.0.61 () {62 vars in 1188 bytes} [Sat Aug 27 02:25:32 2022] POST /compute/v2.1/servers => generated 402 bytes in 707 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 27 02:25:32.840627 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-52763851-e017-44aa-9d6c-ba8cd9a519fb tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:25:32.841456 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-52763851-e017-44aa-9d6c-ba8cd9a519fb tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 99f2f366-4776-427e-99cf-79399835f2c8] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:25:32.902249 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-52763851-e017-44aa-9d6c-ba8cd9a519fb tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:25:32.911563 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-52763851-e017-44aa-9d6c-ba8cd9a519fb tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:25:32.913093 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-52763851-e017-44aa-9d6c-ba8cd9a519fb tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:25:32.914329 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-52763851-e017-44aa-9d6c-ba8cd9a519fb tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8" status: 200 len: 1280 microversion: 2.20 time: 0.078127 Aug 27 02:25:32.915259 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 346/702] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:25:32 2022] GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8 => generated 1280 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:25:33.126053 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-3e85e165-bcde-40e3-99b3-7b90c85b88e2 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:25:33.126722 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-3e85e165-bcde-40e3-99b3-7b90c85b88e2 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] [instance: 49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:25:33.134284 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3e85e165-bcde-40e3-99b3-7b90c85b88e2 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:33.134934 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3e85e165-bcde-40e3-99b3-7b90c85b88e2 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:33.135234 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3e85e165-bcde-40e3-99b3-7b90c85b88e2 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:33.136028 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3e85e165-bcde-40e3-99b3-7b90c85b88e2 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:33.136732 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3e85e165-bcde-40e3-99b3-7b90c85b88e2 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:33.137163 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3e85e165-bcde-40e3-99b3-7b90c85b88e2 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:33.342841 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-3e85e165-bcde-40e3-99b3-7b90c85b88e2 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931dcabba0214e3daa878f31cd1706cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f956d4d27437c830871f6634a3018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:25:33.352276 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-3e85e165-bcde-40e3-99b3-7b90c85b88e2 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] 10.222.0.61 "GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8" status: 200 len: 1755 microversion: 2.1 time: 0.231060 Aug 27 02:25:33.352865 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 357/703] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:25:33 2022] GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8 => generated 1755 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:25:33.939212 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-ff7b34d9-b3a2-43ac-849a-e941d1e27c42 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:25:33.940189 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-ff7b34d9-b3a2-43ac-849a-e941d1e27c42 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 99f2f366-4776-427e-99cf-79399835f2c8] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:25:33.948696 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ff7b34d9-b3a2-43ac-849a-e941d1e27c42 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:33.949583 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ff7b34d9-b3a2-43ac-849a-e941d1e27c42 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:33.950089 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ff7b34d9-b3a2-43ac-849a-e941d1e27c42 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:33.950924 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ff7b34d9-b3a2-43ac-849a-e941d1e27c42 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:33.951457 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ff7b34d9-b3a2-43ac-849a-e941d1e27c42 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:33.951965 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ff7b34d9-b3a2-43ac-849a-e941d1e27c42 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:34.025029 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-ff7b34d9-b3a2-43ac-849a-e941d1e27c42 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:25:34.038948 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-ff7b34d9-b3a2-43ac-849a-e941d1e27c42 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:25:34.041266 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-ff7b34d9-b3a2-43ac-849a-e941d1e27c42 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:25:34.043252 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-ff7b34d9-b3a2-43ac-849a-e941d1e27c42 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8" status: 200 len: 1332 microversion: 2.20 time: 0.109365 Aug 27 02:25:34.044167 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 347/704] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:25:33 2022] GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8 => generated 1332 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:25:34.374373 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-eddd58ef-0127-4091-8f38-f1983baf0800 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:25:34.375056 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-eddd58ef-0127-4091-8f38-f1983baf0800 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] [instance: 49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:25:34.381332 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-eddd58ef-0127-4091-8f38-f1983baf0800 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:34.381848 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-eddd58ef-0127-4091-8f38-f1983baf0800 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:34.382276 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-eddd58ef-0127-4091-8f38-f1983baf0800 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:34.382967 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-eddd58ef-0127-4091-8f38-f1983baf0800 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:34.383413 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-eddd58ef-0127-4091-8f38-f1983baf0800 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:34.383857 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-eddd58ef-0127-4091-8f38-f1983baf0800 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:34.590551 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-eddd58ef-0127-4091-8f38-f1983baf0800 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931dcabba0214e3daa878f31cd1706cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f956d4d27437c830871f6634a3018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:25:34.608104 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-eddd58ef-0127-4091-8f38-f1983baf0800 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] 10.222.0.61 "GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8" status: 200 len: 1755 microversion: 2.1 time: 0.237218 Aug 27 02:25:34.609160 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 358/705] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:25:34 2022] GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8 => generated 1755 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:25:35.068802 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-4198047a-2137-4a53-bb78-4e459f2f782b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:25:35.069635 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-4198047a-2137-4a53-bb78-4e459f2f782b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 99f2f366-4776-427e-99cf-79399835f2c8] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:25:35.077276 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4198047a-2137-4a53-bb78-4e459f2f782b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:35.077889 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4198047a-2137-4a53-bb78-4e459f2f782b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:35.078360 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4198047a-2137-4a53-bb78-4e459f2f782b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:35.079159 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4198047a-2137-4a53-bb78-4e459f2f782b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:35.079814 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4198047a-2137-4a53-bb78-4e459f2f782b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:35.080269 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4198047a-2137-4a53-bb78-4e459f2f782b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:35.158264 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-4198047a-2137-4a53-bb78-4e459f2f782b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:25:35.167244 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-4198047a-2137-4a53-bb78-4e459f2f782b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:25:35.168685 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-4198047a-2137-4a53-bb78-4e459f2f782b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:25:35.169829 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-4198047a-2137-4a53-bb78-4e459f2f782b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8" status: 200 len: 1338 microversion: 2.20 time: 0.106421 Aug 27 02:25:35.170391 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 348/706] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:25:35 2022] GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8 => generated 1338 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:25:35.652488 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-09bc6e99-ca29-468c-b874-198ae01d715b tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:25:35.653122 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-09bc6e99-ca29-468c-b874-198ae01d715b tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] [instance: 49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:25:35.664093 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-09bc6e99-ca29-468c-b874-198ae01d715b tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:35.664995 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-09bc6e99-ca29-468c-b874-198ae01d715b tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:35.665714 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-09bc6e99-ca29-468c-b874-198ae01d715b tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:35.666716 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-09bc6e99-ca29-468c-b874-198ae01d715b tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:35.667359 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-09bc6e99-ca29-468c-b874-198ae01d715b tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:35.668025 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-09bc6e99-ca29-468c-b874-198ae01d715b tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:35.851259 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-09bc6e99-ca29-468c-b874-198ae01d715b tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931dcabba0214e3daa878f31cd1706cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f956d4d27437c830871f6634a3018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:25:35.863051 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-09bc6e99-ca29-468c-b874-198ae01d715b tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] 10.222.0.61 "GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8" status: 200 len: 1755 microversion: 2.1 time: 0.234982 Aug 27 02:25:35.863817 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 359/707] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:25:35 2022] GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8 => generated 1755 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:25:36.172923 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [req-af9f928c-ce59-4e7c-836a-4a6dd777737c req-9e3fe813-5b48-4cc8-ab40-67fa2ed993fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99f2f366-4776-427e-99cf-79399835f2c8", "tag": "dc94d858-1637-4028-b898-2687b284cae7"}]} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:25:36.184489 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-af9f928c-ce59-4e7c-836a-4a6dd777737c req-9e3fe813-5b48-4cc8-ab40-67fa2ed993fa service nova] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:36.185103 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-af9f928c-ce59-4e7c-836a-4a6dd777737c req-9e3fe813-5b48-4cc8-ab40-67fa2ed993fa service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:36.191211 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-af9f928c-ce59-4e7c-836a-4a6dd777737c req-9e3fe813-5b48-4cc8-ab40-67fa2ed993fa service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:36.201384 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-a3fd6811-efe2-4128-a123-8d4bde45a159 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:25:36.204898 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.compute.server_external_events [req-af9f928c-ce59-4e7c-836a-4a6dd777737c req-9e3fe813-5b48-4cc8-ab40-67fa2ed993fa service nova] Creating event network-changed:dc94d858-1637-4028-b898-2687b284cae7 for instance 99f2f366-4776-427e-99cf-79399835f2c8 on hv-cinder-84630 Aug 27 02:25:36.205810 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-a3fd6811-efe2-4128-a123-8d4bde45a159 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 99f2f366-4776-427e-99cf-79399835f2c8] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:25:36.211304 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [req-af9f928c-ce59-4e7c-836a-4a6dd777737c req-9e3fe813-5b48-4cc8-ab40-67fa2ed993fa service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042215 Aug 27 02:25:36.213368 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 349/708] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Aug 27 02:25:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:25:36.222408 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a3fd6811-efe2-4128-a123-8d4bde45a159 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:36.223418 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a3fd6811-efe2-4128-a123-8d4bde45a159 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:36.224493 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a3fd6811-efe2-4128-a123-8d4bde45a159 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:36.226396 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a3fd6811-efe2-4128-a123-8d4bde45a159 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:36.228026 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a3fd6811-efe2-4128-a123-8d4bde45a159 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:36.229135 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a3fd6811-efe2-4128-a123-8d4bde45a159 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:36.407139 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-a3fd6811-efe2-4128-a123-8d4bde45a159 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:25:36.416473 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-a3fd6811-efe2-4128-a123-8d4bde45a159 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:25:36.417970 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-a3fd6811-efe2-4128-a123-8d4bde45a159 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:25:36.419089 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-a3fd6811-efe2-4128-a123-8d4bde45a159 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8" status: 200 len: 1406 microversion: 2.20 time: 0.228799 Aug 27 02:25:36.419648 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 360/709] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:25:36 2022] GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8 => generated 1406 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:25:36.885509 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-958a0b04-2e31-43e5-bce0-05f5bca72e09 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:25:36.886212 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-958a0b04-2e31-43e5-bce0-05f5bca72e09 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] [instance: 49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:25:36.893621 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-958a0b04-2e31-43e5-bce0-05f5bca72e09 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:36.894114 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-958a0b04-2e31-43e5-bce0-05f5bca72e09 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:36.894549 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-958a0b04-2e31-43e5-bce0-05f5bca72e09 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:36.895262 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-958a0b04-2e31-43e5-bce0-05f5bca72e09 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:36.895722 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-958a0b04-2e31-43e5-bce0-05f5bca72e09 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:36.896155 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-958a0b04-2e31-43e5-bce0-05f5bca72e09 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:37.074922 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-958a0b04-2e31-43e5-bce0-05f5bca72e09 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931dcabba0214e3daa878f31cd1706cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f956d4d27437c830871f6634a3018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:25:37.088601 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-958a0b04-2e31-43e5-bce0-05f5bca72e09 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] 10.222.0.61 "GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8" status: 200 len: 1755 microversion: 2.1 time: 0.207326 Aug 27 02:25:37.092393 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 350/710] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:25:36 2022] GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8 => generated 1755 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:25:37.108083 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-963d679a-39c7-4fed-bbe8-6b654527ef24 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:25:37.110498 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-963d679a-39c7-4fed-bbe8-6b654527ef24 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 4fedf0d1-cc1c-4947-b92e-dcb4454889d1] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:25:37.118076 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-963d679a-39c7-4fed-bbe8-6b654527ef24 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:37.118597 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-963d679a-39c7-4fed-bbe8-6b654527ef24 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:37.119043 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-963d679a-39c7-4fed-bbe8-6b654527ef24 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:37.119928 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-963d679a-39c7-4fed-bbe8-6b654527ef24 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:37.120437 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-963d679a-39c7-4fed-bbe8-6b654527ef24 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:37.120917 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-963d679a-39c7-4fed-bbe8-6b654527ef24 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:37.155037 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-963d679a-39c7-4fed-bbe8-6b654527ef24 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050964 Aug 27 02:25:37.156424 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 361/711] 10.222.0.61 () {58 vars in 1302 bytes} [Sat Aug 27 02:25:37 2022] GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 27 02:25:37.222029 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-926f82d0-42bc-4d28-8ff1-1a3331edbe0e tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:25:37.223169 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-926f82d0-42bc-4d28-8ff1-1a3331edbe0e tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 4fedf0d1-cc1c-4947-b92e-dcb4454889d1] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:25:37.230411 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-926f82d0-42bc-4d28-8ff1-1a3331edbe0e tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:37.230770 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-926f82d0-42bc-4d28-8ff1-1a3331edbe0e tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:37.231290 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-926f82d0-42bc-4d28-8ff1-1a3331edbe0e tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:37.232118 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-926f82d0-42bc-4d28-8ff1-1a3331edbe0e tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:37.232627 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-926f82d0-42bc-4d28-8ff1-1a3331edbe0e tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:37.233027 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-926f82d0-42bc-4d28-8ff1-1a3331edbe0e tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:37.264677 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-926f82d0-42bc-4d28-8ff1-1a3331edbe0e tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 4fedf0d1-cc1c-4947-b92e-dcb4454889d1] Going to try to terminate instance {{(pid=120783) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:25:37.368401 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-926f82d0-42bc-4d28-8ff1-1a3331edbe0e tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "DELETE /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1" status: 204 len: 0 microversion: 2.1 time: 0.149510 Aug 27 02:25:37.369451 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 351/712] 10.222.0.61 () {58 vars in 1239 bytes} [Sat Aug 27 02:25:37 2022] DELETE /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 02:25:37.385932 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-f358f02d-4a56-4071-b74c-81539b75c1ed tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:25:37.386668 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-f358f02d-4a56-4071-b74c-81539b75c1ed tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 4fedf0d1-cc1c-4947-b92e-dcb4454889d1] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:25:37.395083 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f358f02d-4a56-4071-b74c-81539b75c1ed tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:37.395550 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f358f02d-4a56-4071-b74c-81539b75c1ed tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:37.396002 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f358f02d-4a56-4071-b74c-81539b75c1ed tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:37.396730 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f358f02d-4a56-4071-b74c-81539b75c1ed tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:37.397183 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f358f02d-4a56-4071-b74c-81539b75c1ed tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:37.397839 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f358f02d-4a56-4071-b74c-81539b75c1ed tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:37.444361 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-4930a05d-be5c-4e81-9eba-18586020bbaa tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:25:37.445196 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-4930a05d-be5c-4e81-9eba-18586020bbaa tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 99f2f366-4776-427e-99cf-79399835f2c8] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:25:37.456115 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4930a05d-be5c-4e81-9eba-18586020bbaa tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:37.457011 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4930a05d-be5c-4e81-9eba-18586020bbaa tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:37.457832 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4930a05d-be5c-4e81-9eba-18586020bbaa tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:37.459225 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4930a05d-be5c-4e81-9eba-18586020bbaa tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:37.459977 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4930a05d-be5c-4e81-9eba-18586020bbaa tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:37.460674 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4930a05d-be5c-4e81-9eba-18586020bbaa tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:37.558934 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-f358f02d-4a56-4071-b74c-81539b75c1ed tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fbea2c71674b239e6d8fba6518e962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d9d02db5c49fda33321f2914a7f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:25:37.571986 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-f358f02d-4a56-4071-b74c-81539b75c1ed tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1" status: 200 len: 1670 microversion: 2.1 time: 0.191192 Aug 27 02:25:37.572818 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 362/713] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:25:37 2022] GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1 => generated 1670 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:25:37.627539 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-4930a05d-be5c-4e81-9eba-18586020bbaa tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:25:37.636460 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-4930a05d-be5c-4e81-9eba-18586020bbaa tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:25:37.637905 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-4930a05d-be5c-4e81-9eba-18586020bbaa tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:25:37.639011 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-4930a05d-be5c-4e81-9eba-18586020bbaa tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8" status: 200 len: 1406 microversion: 2.20 time: 0.199323 Aug 27 02:25:37.639834 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 352/714] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:25:37 2022] GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8 => generated 1406 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:25:38.113599 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-2b0161d1-3e00-4ac2-b4a6-e2930c7c301d tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:25:38.114208 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-2b0161d1-3e00-4ac2-b4a6-e2930c7c301d tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] [instance: 49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:25:38.121223 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2b0161d1-3e00-4ac2-b4a6-e2930c7c301d tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:38.121745 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2b0161d1-3e00-4ac2-b4a6-e2930c7c301d tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:38.122172 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2b0161d1-3e00-4ac2-b4a6-e2930c7c301d tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:38.122904 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2b0161d1-3e00-4ac2-b4a6-e2930c7c301d tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:38.123353 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2b0161d1-3e00-4ac2-b4a6-e2930c7c301d tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:38.123769 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2b0161d1-3e00-4ac2-b4a6-e2930c7c301d tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:38.280314 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-2b0161d1-3e00-4ac2-b4a6-e2930c7c301d tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931dcabba0214e3daa878f31cd1706cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f956d4d27437c830871f6634a3018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:25:38.293962 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-2b0161d1-3e00-4ac2-b4a6-e2930c7c301d tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] 10.222.0.61 "GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8" status: 200 len: 1755 microversion: 2.1 time: 0.184195 Aug 27 02:25:38.294598 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 363/715] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:25:38 2022] GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8 => generated 1755 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:25:38.593701 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-01dbc867-f031-43e8-9d5e-1c44e96170e1 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:25:38.594618 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-01dbc867-f031-43e8-9d5e-1c44e96170e1 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 4fedf0d1-cc1c-4947-b92e-dcb4454889d1] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:25:38.601724 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-01dbc867-f031-43e8-9d5e-1c44e96170e1 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:38.602151 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-01dbc867-f031-43e8-9d5e-1c44e96170e1 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:38.602591 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-01dbc867-f031-43e8-9d5e-1c44e96170e1 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:38.603303 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-01dbc867-f031-43e8-9d5e-1c44e96170e1 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:38.603760 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-01dbc867-f031-43e8-9d5e-1c44e96170e1 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:38.604188 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-01dbc867-f031-43e8-9d5e-1c44e96170e1 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:38.665897 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-8cd68c54-a03a-40dd-9075-055946dbe93d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:25:38.666935 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-8cd68c54-a03a-40dd-9075-055946dbe93d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 99f2f366-4776-427e-99cf-79399835f2c8] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:25:38.675401 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8cd68c54-a03a-40dd-9075-055946dbe93d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:38.676130 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8cd68c54-a03a-40dd-9075-055946dbe93d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:38.676778 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8cd68c54-a03a-40dd-9075-055946dbe93d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:38.677750 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8cd68c54-a03a-40dd-9075-055946dbe93d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:38.678450 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8cd68c54-a03a-40dd-9075-055946dbe93d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:38.679004 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8cd68c54-a03a-40dd-9075-055946dbe93d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:38.710412 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell1:SELECT=100 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:25:38.780609 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-01dbc867-f031-43e8-9d5e-1c44e96170e1 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fbea2c71674b239e6d8fba6518e962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d9d02db5c49fda33321f2914a7f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:25:38.791152 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-01dbc867-f031-43e8-9d5e-1c44e96170e1 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1" status: 200 len: 1670 microversion: 2.1 time: 0.201368 Aug 27 02:25:38.792118 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 353/716] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:25:38 2022] GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1 => generated 1670 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:25:38.876371 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-8cd68c54-a03a-40dd-9075-055946dbe93d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:25:38.886627 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-8cd68c54-a03a-40dd-9075-055946dbe93d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:25:38.888800 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-8cd68c54-a03a-40dd-9075-055946dbe93d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:25:38.891050 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-8cd68c54-a03a-40dd-9075-055946dbe93d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8" status: 200 len: 1406 microversion: 2.20 time: 0.231415 Aug 27 02:25:38.892015 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 364/717] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:25:38 2022] GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8 => generated 1406 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:25:39.317979 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-7099cf06-a947-4c08-8fba-43d525aaedf2 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:25:39.318913 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-7099cf06-a947-4c08-8fba-43d525aaedf2 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] [instance: 49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:25:39.326738 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7099cf06-a947-4c08-8fba-43d525aaedf2 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:39.327223 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7099cf06-a947-4c08-8fba-43d525aaedf2 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:39.327649 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7099cf06-a947-4c08-8fba-43d525aaedf2 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:39.328363 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7099cf06-a947-4c08-8fba-43d525aaedf2 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:39.328787 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7099cf06-a947-4c08-8fba-43d525aaedf2 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:39.329203 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7099cf06-a947-4c08-8fba-43d525aaedf2 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:39.486973 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-7099cf06-a947-4c08-8fba-43d525aaedf2 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931dcabba0214e3daa878f31cd1706cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f956d4d27437c830871f6634a3018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:25:39.499284 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-7099cf06-a947-4c08-8fba-43d525aaedf2 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] 10.222.0.61 "GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8" status: 200 len: 1755 microversion: 2.1 time: 0.186476 Aug 27 02:25:39.504591 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 354/718] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:25:39 2022] GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8 => generated 1755 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:25:39.815871 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-264f85b5-2707-4e3e-b1df-5fd661149cd0 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:25:39.816465 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-264f85b5-2707-4e3e-b1df-5fd661149cd0 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 4fedf0d1-cc1c-4947-b92e-dcb4454889d1] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:25:39.823144 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-264f85b5-2707-4e3e-b1df-5fd661149cd0 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:39.823632 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-264f85b5-2707-4e3e-b1df-5fd661149cd0 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:39.824056 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-264f85b5-2707-4e3e-b1df-5fd661149cd0 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:39.824805 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-264f85b5-2707-4e3e-b1df-5fd661149cd0 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:39.825221 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-264f85b5-2707-4e3e-b1df-5fd661149cd0 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:39.825667 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-264f85b5-2707-4e3e-b1df-5fd661149cd0 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:39.916544 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-de937053-559f-492b-8252-183320ce28ea tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:25:39.918161 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-de937053-559f-492b-8252-183320ce28ea tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 99f2f366-4776-427e-99cf-79399835f2c8] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:25:39.926228 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-de937053-559f-492b-8252-183320ce28ea tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:39.926717 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-de937053-559f-492b-8252-183320ce28ea tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:39.927147 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-de937053-559f-492b-8252-183320ce28ea tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:39.927940 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-de937053-559f-492b-8252-183320ce28ea tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:39.928571 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-de937053-559f-492b-8252-183320ce28ea tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:39.929163 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-de937053-559f-492b-8252-183320ce28ea tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:39.983777 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-264f85b5-2707-4e3e-b1df-5fd661149cd0 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fbea2c71674b239e6d8fba6518e962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d9d02db5c49fda33321f2914a7f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:25:39.992845 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-264f85b5-2707-4e3e-b1df-5fd661149cd0 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1" status: 200 len: 1670 microversion: 2.1 time: 0.180985 Aug 27 02:25:39.993568 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 365/719] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:25:39 2022] GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1 => generated 1670 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:25:40.175362 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-de937053-559f-492b-8252-183320ce28ea tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:25:40.184921 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-de937053-559f-492b-8252-183320ce28ea tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:25:40.186614 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-de937053-559f-492b-8252-183320ce28ea tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:25:40.187937 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-de937053-559f-492b-8252-183320ce28ea tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8" status: 200 len: 1406 microversion: 2.20 time: 0.276284 Aug 27 02:25:40.188611 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 355/720] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:25:39 2022] GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8 => generated 1406 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:25:40.526812 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-d30aa422-2176-4d52-82c7-1c3ed8b4886e tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:25:40.528013 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-d30aa422-2176-4d52-82c7-1c3ed8b4886e tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] [instance: 49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:25:40.540246 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d30aa422-2176-4d52-82c7-1c3ed8b4886e tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:40.541121 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d30aa422-2176-4d52-82c7-1c3ed8b4886e tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:40.541935 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d30aa422-2176-4d52-82c7-1c3ed8b4886e tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:40.543266 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d30aa422-2176-4d52-82c7-1c3ed8b4886e tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:40.544074 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d30aa422-2176-4d52-82c7-1c3ed8b4886e tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:40.544829 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d30aa422-2176-4d52-82c7-1c3ed8b4886e tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:40.751883 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-d30aa422-2176-4d52-82c7-1c3ed8b4886e tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931dcabba0214e3daa878f31cd1706cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f956d4d27437c830871f6634a3018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:25:40.760797 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-d30aa422-2176-4d52-82c7-1c3ed8b4886e tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] 10.222.0.61 "GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8" status: 200 len: 1755 microversion: 2.1 time: 0.241927 Aug 27 02:25:40.761520 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 366/721] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:25:40 2022] GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8 => generated 1755 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:25:41.020908 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-427eee2f-b6d1-40fb-a037-68bd39357183 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:25:41.022144 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-427eee2f-b6d1-40fb-a037-68bd39357183 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 4fedf0d1-cc1c-4947-b92e-dcb4454889d1] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:25:41.030695 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-427eee2f-b6d1-40fb-a037-68bd39357183 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:41.031565 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-427eee2f-b6d1-40fb-a037-68bd39357183 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:41.032267 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-427eee2f-b6d1-40fb-a037-68bd39357183 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:41.033256 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-427eee2f-b6d1-40fb-a037-68bd39357183 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:41.034194 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-427eee2f-b6d1-40fb-a037-68bd39357183 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:41.034941 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-427eee2f-b6d1-40fb-a037-68bd39357183 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:41.063534 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [req-340524dd-83a0-45bf-82e4-d82a467644ca req-5e36dd2f-5fd8-4230-a3e5-c2245cd89d95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99f2f366-4776-427e-99cf-79399835f2c8", "name": "network-vif-plugged", "status": "completed", "tag": "dc94d858-1637-4028-b898-2687b284cae7"}]} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:25:41.098402 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-340524dd-83a0-45bf-82e4-d82a467644ca req-5e36dd2f-5fd8-4230-a3e5-c2245cd89d95 service nova] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:41.099090 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-340524dd-83a0-45bf-82e4-d82a467644ca req-5e36dd2f-5fd8-4230-a3e5-c2245cd89d95 service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:41.099740 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-340524dd-83a0-45bf-82e4-d82a467644ca req-5e36dd2f-5fd8-4230-a3e5-c2245cd89d95 service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:41.129491 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.compute.server_external_events [req-340524dd-83a0-45bf-82e4-d82a467644ca req-5e36dd2f-5fd8-4230-a3e5-c2245cd89d95 service nova] Creating event network-vif-plugged:dc94d858-1637-4028-b898-2687b284cae7 for instance 99f2f366-4776-427e-99cf-79399835f2c8 on hv-cinder-84630 Aug 27 02:25:41.139883 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [req-340524dd-83a0-45bf-82e4-d82a467644ca req-5e36dd2f-5fd8-4230-a3e5-c2245cd89d95 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081135 Aug 27 02:25:41.141817 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 367/722] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Aug 27 02:25:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:25:41.213174 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-8405342a-69d2-4c5b-93cd-d424dc97af10 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:25:41.214281 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-8405342a-69d2-4c5b-93cd-d424dc97af10 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 99f2f366-4776-427e-99cf-79399835f2c8] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:25:41.223292 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8405342a-69d2-4c5b-93cd-d424dc97af10 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:41.223911 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8405342a-69d2-4c5b-93cd-d424dc97af10 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:41.224909 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8405342a-69d2-4c5b-93cd-d424dc97af10 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:41.225884 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8405342a-69d2-4c5b-93cd-d424dc97af10 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:41.226634 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8405342a-69d2-4c5b-93cd-d424dc97af10 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:41.227281 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8405342a-69d2-4c5b-93cd-d424dc97af10 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:41.531105 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-8405342a-69d2-4c5b-93cd-d424dc97af10 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:25:41.546378 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-8405342a-69d2-4c5b-93cd-d424dc97af10 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:25:41.549088 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-8405342a-69d2-4c5b-93cd-d424dc97af10 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:25:41.551217 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-8405342a-69d2-4c5b-93cd-d424dc97af10 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8" status: 200 len: 1406 microversion: 2.20 time: 0.343925 Aug 27 02:25:41.552186 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 368/723] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:25:41 2022] GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8 => generated 1406 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:25:41.783593 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-e4cb63a2-11f1-4250-8dbd-2a441befba0b tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:25:41.784369 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-e4cb63a2-11f1-4250-8dbd-2a441befba0b tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] [instance: 49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:25:41.791919 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e4cb63a2-11f1-4250-8dbd-2a441befba0b tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:41.792417 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e4cb63a2-11f1-4250-8dbd-2a441befba0b tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:41.792856 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e4cb63a2-11f1-4250-8dbd-2a441befba0b tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:41.793647 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e4cb63a2-11f1-4250-8dbd-2a441befba0b tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:41.794068 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e4cb63a2-11f1-4250-8dbd-2a441befba0b tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:41.794507 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e4cb63a2-11f1-4250-8dbd-2a441befba0b tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:41.816236 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-427eee2f-b6d1-40fb-a037-68bd39357183 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fbea2c71674b239e6d8fba6518e962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d9d02db5c49fda33321f2914a7f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:25:41.822227 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:25:41.829781 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-427eee2f-b6d1-40fb-a037-68bd39357183 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1" status: 200 len: 1670 microversion: 2.1 time: 0.816135 Aug 27 02:25:41.830878 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 356/724] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:25:41 2022] GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1 => generated 1670 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:25:41.998471 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-e4cb63a2-11f1-4250-8dbd-2a441befba0b tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931dcabba0214e3daa878f31cd1706cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f956d4d27437c830871f6634a3018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:25:42.007573 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-e4cb63a2-11f1-4250-8dbd-2a441befba0b tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] 10.222.0.61 "GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8" status: 200 len: 1758 microversion: 2.1 time: 0.228898 Aug 27 02:25:42.008165 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 369/725] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:25:41 2022] GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8 => generated 1758 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:25:42.581739 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-02f6e9b5-564b-4627-be84-86d0379ea559 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:25:42.584116 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-02f6e9b5-564b-4627-be84-86d0379ea559 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 99f2f366-4776-427e-99cf-79399835f2c8] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:25:42.596395 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-02f6e9b5-564b-4627-be84-86d0379ea559 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:42.597264 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-02f6e9b5-564b-4627-be84-86d0379ea559 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:42.598176 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-02f6e9b5-564b-4627-be84-86d0379ea559 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:42.599435 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-02f6e9b5-564b-4627-be84-86d0379ea559 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:42.600335 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-02f6e9b5-564b-4627-be84-86d0379ea559 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:42.601056 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-02f6e9b5-564b-4627-be84-86d0379ea559 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:42.805644 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [req-1b0a4b9a-3f6d-4eda-806c-9d813dc91e7c req-3350c1ad-22ec-43fd-b934-1fca0b94c39d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fedf0d1-cc1c-4947-b92e-dcb4454889d1", "name": "network-vif-deleted", "tag": "4bd07b6a-31ef-4e06-8c83-8a4ce8a68542"}]} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:25:42.817574 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell0:SELECT=2 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:25:42.818904 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell0:SELECT=6 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:25:42.829745 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-1b0a4b9a-3f6d-4eda-806c-9d813dc91e7c req-3350c1ad-22ec-43fd-b934-1fca0b94c39d service nova] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:42.830920 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-1b0a4b9a-3f6d-4eda-806c-9d813dc91e7c req-3350c1ad-22ec-43fd-b934-1fca0b94c39d service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:42.831639 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-1b0a4b9a-3f6d-4eda-806c-9d813dc91e7c req-3350c1ad-22ec-43fd-b934-1fca0b94c39d service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:42.855355 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.compute.server_external_events [req-1b0a4b9a-3f6d-4eda-806c-9d813dc91e7c req-3350c1ad-22ec-43fd-b934-1fca0b94c39d service nova] Creating event network-vif-deleted:4bd07b6a-31ef-4e06-8c83-8a4ce8a68542 for instance 4fedf0d1-cc1c-4947-b92e-dcb4454889d1 on hv-cinder-84630 Aug 27 02:25:42.860047 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [req-1b0a4b9a-3f6d-4eda-806c-9d813dc91e7c req-3350c1ad-22ec-43fd-b934-1fca0b94c39d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059773 Aug 27 02:25:42.861589 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 370/726] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Aug 27 02:25:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:25:42.868621 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-21b66626-e86d-499f-a37e-12cb5158782f tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:25:42.869548 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-21b66626-e86d-499f-a37e-12cb5158782f tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 4fedf0d1-cc1c-4947-b92e-dcb4454889d1] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:25:42.876812 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-21b66626-e86d-499f-a37e-12cb5158782f tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:42.877429 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-21b66626-e86d-499f-a37e-12cb5158782f tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:42.877943 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-21b66626-e86d-499f-a37e-12cb5158782f tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:42.878727 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-21b66626-e86d-499f-a37e-12cb5158782f tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:42.879248 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-21b66626-e86d-499f-a37e-12cb5158782f tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:42.879767 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-21b66626-e86d-499f-a37e-12cb5158782f tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:42.908053 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell0:SELECT=6 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:25:42.979196 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-21b66626-e86d-499f-a37e-12cb5158782f tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fbea2c71674b239e6d8fba6518e962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d9d02db5c49fda33321f2914a7f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:25:42.994169 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-21b66626-e86d-499f-a37e-12cb5158782f tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1" status: 200 len: 1603 microversion: 2.1 time: 0.129377 Aug 27 02:25:42.995477 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 371/727] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:25:42 2022] GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1 => generated 1603 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:25:43.016709 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-02f6e9b5-564b-4627-be84-86d0379ea559 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:25:43.025816 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-02f6e9b5-564b-4627-be84-86d0379ea559 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:25:43.027312 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-02f6e9b5-564b-4627-be84-86d0379ea559 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:25:43.028575 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-02f6e9b5-564b-4627-be84-86d0379ea559 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8" status: 200 len: 1406 microversion: 2.20 time: 0.454459 Aug 27 02:25:43.029044 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 357/728] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:25:42 2022] GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8 => generated 1406 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:25:43.186571 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [req-25cdb813-0623-418e-8371-9a52c776dc76 req-41070a47-35ff-4d53-88d1-76c650a426ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fedf0d1-cc1c-4947-b92e-dcb4454889d1", "name": "network-vif-unplugged", "status": "completed", "tag": "4bd07b6a-31ef-4e06-8c83-8a4ce8a68542"}]} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:25:43.196927 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-25cdb813-0623-418e-8371-9a52c776dc76 req-41070a47-35ff-4d53-88d1-76c650a426ce service nova] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:43.197430 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-25cdb813-0623-418e-8371-9a52c776dc76 req-41070a47-35ff-4d53-88d1-76c650a426ce service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:43.197852 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-25cdb813-0623-418e-8371-9a52c776dc76 req-41070a47-35ff-4d53-88d1-76c650a426ce service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:43.217067 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.compute.server_external_events [req-25cdb813-0623-418e-8371-9a52c776dc76 req-41070a47-35ff-4d53-88d1-76c650a426ce service nova] Creating event network-vif-unplugged:4bd07b6a-31ef-4e06-8c83-8a4ce8a68542 for instance 4fedf0d1-cc1c-4947-b92e-dcb4454889d1 on hv-cinder-84630 Aug 27 02:25:43.223607 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [req-25cdb813-0623-418e-8371-9a52c776dc76 req-41070a47-35ff-4d53-88d1-76c650a426ce service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041274 Aug 27 02:25:43.224890 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 372/729] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Aug 27 02:25:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:25:44.023360 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-406573d7-369b-4fa6-afb3-47705200f8a6 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:25:44.024153 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-406573d7-369b-4fa6-afb3-47705200f8a6 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 4fedf0d1-cc1c-4947-b92e-dcb4454889d1] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:25:44.030240 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-406573d7-369b-4fa6-afb3-47705200f8a6 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:44.030724 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-406573d7-369b-4fa6-afb3-47705200f8a6 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:44.031191 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-406573d7-369b-4fa6-afb3-47705200f8a6 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:44.032940 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-406573d7-369b-4fa6-afb3-47705200f8a6 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:44.032940 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-406573d7-369b-4fa6-afb3-47705200f8a6 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:44.032940 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-406573d7-369b-4fa6-afb3-47705200f8a6 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:44.056047 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-4cbcdd4e-0bc1-4e5e-80a0-bf1e3f1f55ec tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:25:44.056693 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-4cbcdd4e-0bc1-4e5e-80a0-bf1e3f1f55ec tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 99f2f366-4776-427e-99cf-79399835f2c8] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:25:44.063712 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4cbcdd4e-0bc1-4e5e-80a0-bf1e3f1f55ec tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:44.064178 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4cbcdd4e-0bc1-4e5e-80a0-bf1e3f1f55ec tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:44.064617 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4cbcdd4e-0bc1-4e5e-80a0-bf1e3f1f55ec tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:44.065329 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4cbcdd4e-0bc1-4e5e-80a0-bf1e3f1f55ec tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:44.065810 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4cbcdd4e-0bc1-4e5e-80a0-bf1e3f1f55ec tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:44.066659 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4cbcdd4e-0bc1-4e5e-80a0-bf1e3f1f55ec tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:44.074884 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-406573d7-369b-4fa6-afb3-47705200f8a6 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:44.075562 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-406573d7-369b-4fa6-afb3-47705200f8a6 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:44.076117 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-406573d7-369b-4fa6-afb3-47705200f8a6 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:44.076742 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.objects.instance [None req-406573d7-369b-4fa6-afb3-47705200f8a6 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lazy-loading 'fault' on Instance uuid 4fedf0d1-cc1c-4947-b92e-dcb4454889d1 {{(pid=120783) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:25:44.125636 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-406573d7-369b-4fa6-afb3-47705200f8a6 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fbea2c71674b239e6d8fba6518e962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d9d02db5c49fda33321f2914a7f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:25:44.138456 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-406573d7-369b-4fa6-afb3-47705200f8a6 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1" status: 200 len: 1326 microversion: 2.1 time: 0.121640 Aug 27 02:25:44.139210 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 358/730] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:25:44 2022] GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1 => generated 1326 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:25:44.277034 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-4cbcdd4e-0bc1-4e5e-80a0-bf1e3f1f55ec tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:25:44.285620 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-4cbcdd4e-0bc1-4e5e-80a0-bf1e3f1f55ec tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:25:44.287110 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-4cbcdd4e-0bc1-4e5e-80a0-bf1e3f1f55ec tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:25:44.288284 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-4cbcdd4e-0bc1-4e5e-80a0-bf1e3f1f55ec tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8" status: 200 len: 1598 microversion: 2.20 time: 0.236731 Aug 27 02:25:44.288871 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 373/731] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:25:44 2022] GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8 => generated 1598 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:25:44.311218 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-6190fc14-9974-479f-9078-6e5ae56206ce tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:25:44.311599 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-6190fc14-9974-479f-9078-6e5ae56206ce tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 99f2f366-4776-427e-99cf-79399835f2c8] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:25:44.319586 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6190fc14-9974-479f-9078-6e5ae56206ce tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:44.320112 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6190fc14-9974-479f-9078-6e5ae56206ce tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:44.320716 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6190fc14-9974-479f-9078-6e5ae56206ce tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:44.321625 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6190fc14-9974-479f-9078-6e5ae56206ce tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:44.322245 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6190fc14-9974-479f-9078-6e5ae56206ce tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:44.322672 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6190fc14-9974-479f-9078-6e5ae56206ce tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:44.410407 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-6190fc14-9974-479f-9078-6e5ae56206ce tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.103296 Aug 27 02:25:44.411246 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 359/732] 10.222.0.61 () {60 vars in 1316 bytes} [Sat Aug 27 02:25:44 2022] GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8/os-interface => generated 284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:25:45.162061 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-93dd453f-37bc-4417-9f4e-df7b5f3236af tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:25:45.162874 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-93dd453f-37bc-4417-9f4e-df7b5f3236af tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 4fedf0d1-cc1c-4947-b92e-dcb4454889d1] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:25:45.170967 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-93dd453f-37bc-4417-9f4e-df7b5f3236af tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:45.171751 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-93dd453f-37bc-4417-9f4e-df7b5f3236af tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:45.172217 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-93dd453f-37bc-4417-9f4e-df7b5f3236af tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:45.173214 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-93dd453f-37bc-4417-9f4e-df7b5f3236af tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:45.173768 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-93dd453f-37bc-4417-9f4e-df7b5f3236af tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:45.174263 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-93dd453f-37bc-4417-9f4e-df7b5f3236af tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:45.189376 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.wsgi [None req-93dd453f-37bc-4417-9f4e-df7b5f3236af tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] HTTP exception thrown: Instance 4fedf0d1-cc1c-4947-b92e-dcb4454889d1 could not be found. Aug 27 02:25:45.191148 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-93dd453f-37bc-4417-9f4e-df7b5f3236af tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Request method failure captured: Aug 27 02:25:45.191148 dv-cinder-846303-3-smb devstack@n-api.service[120782]: request: GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1 HTTP/1.1 Aug 27 02:25:45.191148 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Accept: application/json Aug 27 02:25:45.191148 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Accept-Encoding: identity Aug 27 02:25:45.191148 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Connection: close Aug 27 02:25:45.191148 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Content-Length: 0 Aug 27 02:25:45.191148 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Content-Type: application/json Aug 27 02:25:45.191148 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Host: 10.222.0.61 Aug 27 02:25:45.191148 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Openstack-System-Scope: None Aug 27 02:25:45.191148 dv-cinder-846303-3-smb devstack@n-api.service[120782]: User-Agent: python-urllib3/1.26.11 Aug 27 02:25:45.191148 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Auth-Token: gAAAAABjCX-ShfB0Coaj3qVvwoKWmdl3PwzJlje6e22a1Tn3Z-uAvHSJt5iaP5MRmnkzn9IjS7AEfrhus0KHaJgfcKR_uRUzVeWPR9Na-S79Vt8JP774XerEcGj7zs3nh-Whn3Unfno_0WbmWxEFC26pdlS_80IB2Gyidtvp_uirhBgTOiieqV0 Aug 27 02:25:45.191148 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Domain-Id: None Aug 27 02:25:45.191148 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Domain-Name: None Aug 27 02:25:45.191148 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Identity-Status: Confirmed Aug 27 02:25:45.191148 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Is-Admin-Project: True Aug 27 02:25:45.191148 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Domain-Id: default Aug 27 02:25:45.191148 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Domain-Name: Default Aug 27 02:25:45.191148 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Id: 782d9d02db5c49fda33321f2914a7f31 Aug 27 02:25:45.191148 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Name: tempest-AttachVolumeTestJSON-1060962345 Aug 27 02:25:45.191148 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Role: member,reader Aug 27 02:25:45.191148 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Roles: member,reader Aug 27 02:25:45.193362 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/782d9d02db5c49fda33321f2914a7f31"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_782d9d02db5c49fda33321f2914a7f31", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/782d9d02db5c49fda33321f2914a7f31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/782d9d02db5c49fda33321f2914a7f31"}]}] Aug 27 02:25:45.193362 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Tenant: tempest-AttachVolumeTestJSON-1060962345 Aug 27 02:25:45.193362 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Tenant-Id: 782d9d02db5c49fda33321f2914a7f31 Aug 27 02:25:45.193362 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1060962345 Aug 27 02:25:45.193362 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User: tempest-AttachVolumeTestJSON-1060962345-project Aug 27 02:25:45.193362 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Domain-Id: default Aug 27 02:25:45.193362 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Domain-Name: Default Aug 27 02:25:45.193362 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Id: 22fbea2c71674b239e6d8fba6518e962 Aug 27 02:25:45.193362 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Name: tempest-AttachVolumeTestJSON-1060962345-project Aug 27 02:25:45.193362 dv-cinder-846303-3-smb devstack@n-api.service[120782]: method: > Aug 27 02:25:45.193362 dv-cinder-846303-3-smb devstack@n-api.service[120782]: exception: Instance 4fedf0d1-cc1c-4947-b92e-dcb4454889d1 could not be found. Aug 27 02:25:45.193362 dv-cinder-846303-3-smb devstack@n-api.service[120782]: action_args: {'id': '4fedf0d1-cc1c-4947-b92e-dcb4454889d1'} Aug 27 02:25:45.194455 dv-cinder-846303-3-smb devstack@n-api.service[120782]: {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:25:45.194455 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:25:45.194455 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:25:45.194455 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:25:45.194455 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:25:45.194455 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:25:45.194455 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:25:45.194455 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:25:45.194455 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:25:45.194455 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:25:45.194455 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fedf0d1-cc1c-4947-b92e-dcb4454889d1 could not be found. Aug 27 02:25:45.194455 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:25:45.194455 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:25:45.194455 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:25:45.194455 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:25:45.194455 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:25:45.194455 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:25:45.194455 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:25:45.194455 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:25:45.194455 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:25:45.197208 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:25:45.197208 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:25:45.197208 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:25:45.197208 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:25:45.197208 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:25:45.197208 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:25:45.197208 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:25:45.197208 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fedf0d1-cc1c-4947-b92e-dcb4454889d1 could not be found. Aug 27 02:25:45.197208 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:25:45.197208 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:25:45.197208 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:25:45.197208 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:25:45.197208 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:25:45.197208 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:25:45.197208 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:25:45.197208 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:25:45.197208 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fedf0d1-cc1c-4947-b92e-dcb4454889d1 could not be found. Aug 27 02:25:45.197208 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:25:45.198870 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-93dd453f-37bc-4417-9f4e-df7b5f3236af tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Returning 404 to user: Instance 4fedf0d1-cc1c-4947-b92e-dcb4454889d1 could not be found. {{(pid=120782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:25:45.198870 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-93dd453f-37bc-4417-9f4e-df7b5f3236af tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1" status: 404 len: 111 microversion: 2.1 time: 0.035593 Aug 27 02:25:45.198870 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 374/733] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:25:45 2022] GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:25:45.205789 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-ee457933-20e4-49ec-8c9d-23999e371e96 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Calling method '.version_select at 0x7fd8082f1dc0>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:25:45.229277 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-ee457933-20e4-49ec-8c9d-23999e371e96 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-942727149" status: 202 len: 0 microversion: 2.1 time: 0.027875 Aug 27 02:25:45.230237 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 360/734] 10.222.0.61 () {58 vars in 1218 bytes} [Sat Aug 27 02:25:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-942727149 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:25:45.736404 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [req-c544dda3-3f16-4423-8a8a-966b20087547 req-2e56e78e-7b27-4732-96ff-2e96a2feb412 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99f2f366-4776-427e-99cf-79399835f2c8", "tag": "dc94d858-1637-4028-b898-2687b284cae7"}]} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:25:45.747361 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-c544dda3-3f16-4423-8a8a-966b20087547 req-2e56e78e-7b27-4732-96ff-2e96a2feb412 service nova] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:45.748161 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-c544dda3-3f16-4423-8a8a-966b20087547 req-2e56e78e-7b27-4732-96ff-2e96a2feb412 service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:45.748764 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-c544dda3-3f16-4423-8a8a-966b20087547 req-2e56e78e-7b27-4732-96ff-2e96a2feb412 service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:45.763306 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.compute.server_external_events [req-c544dda3-3f16-4423-8a8a-966b20087547 req-2e56e78e-7b27-4732-96ff-2e96a2feb412 service nova] Creating event network-changed:dc94d858-1637-4028-b898-2687b284cae7 for instance 99f2f366-4776-427e-99cf-79399835f2c8 on hv-cinder-84630 Aug 27 02:25:45.769601 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [req-c544dda3-3f16-4423-8a8a-966b20087547 req-2e56e78e-7b27-4732-96ff-2e96a2feb412 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037540 Aug 27 02:25:45.770495 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 375/735] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Aug 27 02:25:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:25:46.253478 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-7505a9bb-2af3-441d-97d3-c8482d876490 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Action: 'create', calling method: .version_select at 0x7fd8083fc670>, body: {"keypair": {"name": "tempest-keypair-651628831", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNQmgXNxID8cV6KxQVUbAHebeW6iZYlP0FVC8iJILuRiQkgyXNMxqsZOAfisS5i0Wl/LQuISvuyT8HCbNY8Zhqh4JuOZ5UQ3V/RwdhjXQ4Ih0hhkv2VR4gWU3qJxf3kX6Q=="}} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:25:46.281542 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.quota [None req-7505a9bb-2af3-441d-97d3-c8482d876490 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Getting quotas for project 782d9d02db5c49fda33321f2914a7f31. Resources: {'key_pairs'} {{(pid=120783) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:25:46.286247 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.quota [None req-7505a9bb-2af3-441d-97d3-c8482d876490 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Getting quotas for user 22fbea2c71674b239e6d8fba6518e962 and project 782d9d02db5c49fda33321f2914a7f31. Resources: {'key_pairs'} {{(pid=120783) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:25:46.326623 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-7505a9bb-2af3-441d-97d3-c8482d876490 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.077473 Aug 27 02:25:46.327822 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 361/736] 10.222.0.61 () {60 vars in 1159 bytes} [Sat Aug 27 02:25:46 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:25:47.137533 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-a5836973-80f6-4c30-bc53-04b630f968e8 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:25:47.138170 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-a5836973-80f6-4c30-bc53-04b630f968e8 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: 77c3697a-5b72-4f66-9ba0-0fba67484286] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:25:47.145348 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a5836973-80f6-4c30-bc53-04b630f968e8 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:47.145861 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a5836973-80f6-4c30-bc53-04b630f968e8 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:47.146286 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a5836973-80f6-4c30-bc53-04b630f968e8 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:47.147011 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a5836973-80f6-4c30-bc53-04b630f968e8 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:47.147430 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a5836973-80f6-4c30-bc53-04b630f968e8 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:47.147878 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a5836973-80f6-4c30-bc53-04b630f968e8 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:47.173245 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-a5836973-80f6-4c30-bc53-04b630f968e8 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/77c3697a-5b72-4f66-9ba0-0fba67484286/ips" status: 200 len: 151 microversion: 2.1 time: 0.040503 Aug 27 02:25:47.180778 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 376/737] 10.222.0.61 () {58 vars in 1248 bytes} [Sat Aug 27 02:25:47 2022] GET /compute/v2.1/servers/77c3697a-5b72-4f66-9ba0-0fba67484286/ips => generated 151 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:25:47.905234 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-1a536982-dce3-480a-81b4-678381de851e tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1352506473", "imageRef": "7d45cdd6-750f-40c7-9475-f7bf12fcb204", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8633f64f-0c3f-48ab-92cc-dfeb181a68a4"}], "security_groups": [{"name": "tempest-securitygroup--2127026543"}], "key_name": "tempest-keypair-651628831", "user_data": "}} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:25:48.017799 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.network.neutron [None req-1a536982-dce3-480a-81b4-678381de851e tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] validate_networks() for [('8633f64f-0c3f-48ab-92cc-dfeb181a68a4', None, None, None, None, None)] {{(pid=120783) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:25:48.607070 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-87a8d752-b339-4cb2-a7ba-dbfc00d187b2 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "82dbb4d8-0d82-48ec-9b9c-1d4c0042fe4b"}} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:25:48.609191 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-87a8d752-b339-4cb2-a7ba-dbfc00d187b2 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: 77c3697a-5b72-4f66-9ba0-0fba67484286] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:25:48.616529 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-87a8d752-b339-4cb2-a7ba-dbfc00d187b2 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:48.616529 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-87a8d752-b339-4cb2-a7ba-dbfc00d187b2 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:48.616856 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-87a8d752-b339-4cb2-a7ba-dbfc00d187b2 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:48.617479 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-87a8d752-b339-4cb2-a7ba-dbfc00d187b2 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:48.618136 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-87a8d752-b339-4cb2-a7ba-dbfc00d187b2 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:48.618554 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-87a8d752-b339-4cb2-a7ba-dbfc00d187b2 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:48.710690 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.virt.hardware [None req-1a536982-dce3-480a-81b4-678381de851e tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Flavor limits 0:0:0 {{(pid=120783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:25:48.711112 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.virt.hardware [None req-1a536982-dce3-480a-81b4-678381de851e tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Image limits 0:0:0 {{(pid=120783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:25:48.711576 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.virt.hardware [None req-1a536982-dce3-480a-81b4-678381de851e tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Flavor pref 0:0:0 {{(pid=120783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:25:48.711977 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.virt.hardware [None req-1a536982-dce3-480a-81b4-678381de851e tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Image pref 0:0:0 {{(pid=120783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:25:48.712381 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.virt.hardware [None req-1a536982-dce3-480a-81b4-678381de851e tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:25:48.723773 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1a536982-dce3-480a-81b4-678381de851e tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:48.724073 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1a536982-dce3-480a-81b4-678381de851e tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:48.724377 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1a536982-dce3-480a-81b4-678381de851e tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:48.725095 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1a536982-dce3-480a-81b4-678381de851e tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:48.725584 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1a536982-dce3-480a-81b4-678381de851e tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:48.726006 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1a536982-dce3-480a-81b4-678381de851e tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:48.747010 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.quota [None req-1a536982-dce3-480a-81b4-678381de851e tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Getting quotas for project 782d9d02db5c49fda33321f2914a7f31. Resources: {'instances', 'ram', 'cores'} {{(pid=120783) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:25:48.754256 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.quota [None req-1a536982-dce3-480a-81b4-678381de851e tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Getting quotas for user 22fbea2c71674b239e6d8fba6518e962 and project 782d9d02db5c49fda33321f2914a7f31. Resources: {'instances', 'ram', 'cores'} {{(pid=120783) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:25:48.768942 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-1a536982-dce3-480a-81b4-678381de851e tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Going to run 1 instances... {{(pid=120783) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:25:48.771358 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-1a536982-dce3-480a-81b4-678381de851e tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 9cad910f-6edf-4462-9db0-4e7f0a060620] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7d45cdd6-750f-40c7-9475-f7bf12fcb204',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120783) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:25:48.819643 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-1a536982-dce3-480a-81b4-678381de851e tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.919353 Aug 27 02:25:48.826147 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 362/738] 10.222.0.61 () {60 vars in 1147 bytes} [Sat Aug 27 02:25:47 2022] POST /compute/v2.1/servers => generated 402 bytes in 921 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:25:48.842126 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-4d965590-61f2-430d-98c8-1254c94333c9 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:25:48.842792 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-4d965590-61f2-430d-98c8-1254c94333c9 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 9cad910f-6edf-4462-9db0-4e7f0a060620] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:25:48.954604 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-4d965590-61f2-430d-98c8-1254c94333c9 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fbea2c71674b239e6d8fba6518e962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d9d02db5c49fda33321f2914a7f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:25:48.967167 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-4d965590-61f2-430d-98c8-1254c94333c9 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "GET /compute/v2.1/servers/9cad910f-6edf-4462-9db0-4e7f0a060620" status: 200 len: 1237 microversion: 2.1 time: 0.138581 Aug 27 02:25:48.969457 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 363/739] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:25:48 2022] GET /compute/v2.1/servers/9cad910f-6edf-4462-9db0-4e7f0a060620 => generated 1237 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:25:49.048784 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-87a8d752-b339-4cb2-a7ba-dbfc00d187b2 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "POST /compute/v2.1/servers/77c3697a-5b72-4f66-9ba0-0fba67484286/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.445722 Aug 27 02:25:49.049815 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 377/740] 10.222.0.61 () {60 vars in 1323 bytes} [Sat Aug 27 02:25:48 2022] POST /compute/v2.1/servers/77c3697a-5b72-4f66-9ba0-0fba67484286/os-volume_attachments => generated 194 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:25:50.000239 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-ac40c283-2cc0-437e-8c57-9b74877784c0 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:25:50.000885 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-ac40c283-2cc0-437e-8c57-9b74877784c0 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 9cad910f-6edf-4462-9db0-4e7f0a060620] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:25:50.007937 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ac40c283-2cc0-437e-8c57-9b74877784c0 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:50.008421 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ac40c283-2cc0-437e-8c57-9b74877784c0 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:50.008858 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ac40c283-2cc0-437e-8c57-9b74877784c0 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:50.009592 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ac40c283-2cc0-437e-8c57-9b74877784c0 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:50.010230 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ac40c283-2cc0-437e-8c57-9b74877784c0 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:50.010474 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ac40c283-2cc0-437e-8c57-9b74877784c0 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:50.082734 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-ac40c283-2cc0-437e-8c57-9b74877784c0 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fbea2c71674b239e6d8fba6518e962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d9d02db5c49fda33321f2914a7f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:25:50.090971 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-ac40c283-2cc0-437e-8c57-9b74877784c0 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "GET /compute/v2.1/servers/9cad910f-6edf-4462-9db0-4e7f0a060620" status: 200 len: 1289 microversion: 2.1 time: 0.094777 Aug 27 02:25:50.091530 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 364/741] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:25:49 2022] GET /compute/v2.1/servers/9cad910f-6edf-4462-9db0-4e7f0a060620 => generated 1289 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:25:51.113948 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-93c5a893-a4bd-4489-a18f-650df0e2d2d2 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:25:51.114610 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-93c5a893-a4bd-4489-a18f-650df0e2d2d2 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 9cad910f-6edf-4462-9db0-4e7f0a060620] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:25:51.116662 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:25:51.122654 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-93c5a893-a4bd-4489-a18f-650df0e2d2d2 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:51.123109 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-93c5a893-a4bd-4489-a18f-650df0e2d2d2 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:51.123543 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-93c5a893-a4bd-4489-a18f-650df0e2d2d2 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:51.124244 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-93c5a893-a4bd-4489-a18f-650df0e2d2d2 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:51.124670 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-93c5a893-a4bd-4489-a18f-650df0e2d2d2 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:51.125088 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-93c5a893-a4bd-4489-a18f-650df0e2d2d2 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:51.192008 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-93c5a893-a4bd-4489-a18f-650df0e2d2d2 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fbea2c71674b239e6d8fba6518e962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d9d02db5c49fda33321f2914a7f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:25:51.200266 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-93c5a893-a4bd-4489-a18f-650df0e2d2d2 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "GET /compute/v2.1/servers/9cad910f-6edf-4462-9db0-4e7f0a060620" status: 200 len: 1289 microversion: 2.1 time: 0.091631 Aug 27 02:25:51.200837 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 378/742] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:25:51 2022] GET /compute/v2.1/servers/9cad910f-6edf-4462-9db0-4e7f0a060620 => generated 1289 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:25:51.332500 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-3a8e5cbd-88ec-466d-a86e-16938ec72879 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "82dbb4d8-0d82-48ec-9b9c-1d4c0042fe4b"}} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:25:51.335363 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-3a8e5cbd-88ec-466d-a86e-16938ec72879 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: 77c3697a-5b72-4f66-9ba0-0fba67484286] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:25:51.337858 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:25:51.343975 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3a8e5cbd-88ec-466d-a86e-16938ec72879 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:51.344465 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3a8e5cbd-88ec-466d-a86e-16938ec72879 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:51.344905 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3a8e5cbd-88ec-466d-a86e-16938ec72879 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:51.345646 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3a8e5cbd-88ec-466d-a86e-16938ec72879 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:51.346284 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3a8e5cbd-88ec-466d-a86e-16938ec72879 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:51.346707 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3a8e5cbd-88ec-466d-a86e-16938ec72879 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:51.461080 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.wsgi [None req-3a8e5cbd-88ec-466d-a86e-16938ec72879 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] HTTP exception thrown: Invalid volume: volume 82dbb4d8-0d82-48ec-9b9c-1d4c0042fe4b is already attached to instances: 77c3697a-5b72-4f66-9ba0-0fba67484286 Aug 27 02:25:51.462909 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-3a8e5cbd-88ec-466d-a86e-16938ec72879 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Request method failure captured: Aug 27 02:25:51.462909 dv-cinder-846303-3-smb devstack@n-api.service[120783]: request: POST /compute/v2.1/servers/77c3697a-5b72-4f66-9ba0-0fba67484286/os-volume_attachments HTTP/1.1 Aug 27 02:25:51.462909 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Accept: application/json Aug 27 02:25:51.462909 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Accept-Encoding: identity Aug 27 02:25:51.462909 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Connection: close Aug 27 02:25:51.462909 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Content-Length: 74 Aug 27 02:25:51.462909 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Content-Type: application/json Aug 27 02:25:51.462909 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Host: 10.222.0.61 Aug 27 02:25:51.462909 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Openstack-System-Scope: None Aug 27 02:25:51.462909 dv-cinder-846303-3-smb devstack@n-api.service[120783]: User-Agent: python-urllib3/1.26.11 Aug 27 02:25:51.462909 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Auth-Token: gAAAAABjCX-GZMxBoDm0UEKrtF9w1zn8zf5k_pRKs9w1w8QBRmamyePi9gdcvRwYzK044f89BKz1wZ6FALfNLv1C6uDnz_VZDZcPY_z2HcyDI5nmMGMvL5rG2v4zh3O1IrszVG_kNPPcMoviX7QaOQhXuRqD1X6DsEJwS6gyWrQ-SPSaYeWVQOw Aug 27 02:25:51.462909 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Domain-Id: None Aug 27 02:25:51.462909 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Domain-Name: None Aug 27 02:25:51.462909 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Identity-Status: Confirmed Aug 27 02:25:51.462909 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Is-Admin-Project: True Aug 27 02:25:51.462909 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Project-Domain-Id: default Aug 27 02:25:51.462909 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Project-Domain-Name: Default Aug 27 02:25:51.462909 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Project-Id: 8aa1c411b57d4e72885dac2b4f4dfe7a Aug 27 02:25:51.462909 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Project-Name: tempest-AttachVolumeNegativeTest-799378516 Aug 27 02:25:51.462909 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Role: member,reader Aug 27 02:25:51.462909 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Roles: member,reader Aug 27 02:25:51.464317 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/8aa1c411b57d4e72885dac2b4f4dfe7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_8aa1c411b57d4e72885dac2b4f4dfe7a", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8aa1c411b57d4e72885dac2b4f4dfe7a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8aa1c411b57d4e72885dac2b4f4dfe7a"}]}] Aug 27 02:25:51.464317 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Tenant: tempest-AttachVolumeNegativeTest-799378516 Aug 27 02:25:51.464317 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Tenant-Id: 8aa1c411b57d4e72885dac2b4f4dfe7a Aug 27 02:25:51.464317 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-799378516 Aug 27 02:25:51.464317 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User: tempest-AttachVolumeNegativeTest-799378516-project Aug 27 02:25:51.464317 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User-Domain-Id: default Aug 27 02:25:51.464317 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User-Domain-Name: Default Aug 27 02:25:51.464317 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User-Id: 4a6f819365574091ae344f14e47f487f Aug 27 02:25:51.464317 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User-Name: tempest-AttachVolumeNegativeTest-799378516-project Aug 27 02:25:51.464317 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Aug 27 02:25:51.464317 dv-cinder-846303-3-smb devstack@n-api.service[120783]: {"volumeAttachment": {"volumeId": "82dbb4d8-0d82-48ec-9b9c-1d4c0042fe4b"}} Aug 27 02:25:51.464317 dv-cinder-846303-3-smb devstack@n-api.service[120783]: method: > Aug 27 02:25:51.465161 dv-cinder-846303-3-smb devstack@n-api.service[120783]: exception: Invalid volume: volume 82dbb4d8-0d82-48ec-9b9c-1d4c0042fe4b is already attached to instances: 77c3697a-5b72-4f66-9ba0-0fba67484286 Aug 27 02:25:51.465161 dv-cinder-846303-3-smb devstack@n-api.service[120783]: action_args: {'server_id': '77c3697a-5b72-4f66-9ba0-0fba67484286', 'body': {'volumeAttachment': {'volumeId': '82dbb4d8-0d82-48ec-9b9c-1d4c0042fe4b'}}} Aug 27 02:25:51.465161 dv-cinder-846303-3-smb devstack@n-api.service[120783]: {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:25:51.465161 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:25:51.465161 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 27 02:25:51.465161 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 27 02:25:51.465161 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 02:25:51.465161 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 02:25:51.465161 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 27 02:25:51.465161 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 02:25:51.465161 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 27 02:25:51.465161 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 27 02:25:51.465161 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 27 02:25:51.465161 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 27 02:25:51.465161 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 82dbb4d8-0d82-48ec-9b9c-1d4c0042fe4b is already attached to instances: 77c3697a-5b72-4f66-9ba0-0fba67484286 Aug 27 02:25:51.465161 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:25:51.465161 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:25:51.465161 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:25:51.465161 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:25:51.466426 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:25:51.466426 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:25:51.466426 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:25:51.466426 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:25:51.466426 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:25:51.466426 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:25:51.466426 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:25:51.466426 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:25:51.466426 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:25:51.466426 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:25:51.466426 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:25:51.466426 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:25:51.466426 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 27 02:25:51.466426 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 27 02:25:51.466426 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 82dbb4d8-0d82-48ec-9b9c-1d4c0042fe4b is already attached to instances: 77c3697a-5b72-4f66-9ba0-0fba67484286 Aug 27 02:25:51.466426 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:25:51.466426 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:25:51.466426 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:25:51.466426 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:25:51.466426 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:25:51.468071 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:25:51.468071 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:25:51.468071 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:25:51.468071 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 82dbb4d8-0d82-48ec-9b9c-1d4c0042fe4b is already attached to instances: 77c3697a-5b72-4f66-9ba0-0fba67484286 Aug 27 02:25:51.468071 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:25:51.468071 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-3a8e5cbd-88ec-466d-a86e-16938ec72879 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Returning 400 to user: Invalid volume: volume 82dbb4d8-0d82-48ec-9b9c-1d4c0042fe4b is already attached to instances: 77c3697a-5b72-4f66-9ba0-0fba67484286 {{(pid=120783) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:25:51.468071 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-3a8e5cbd-88ec-466d-a86e-16938ec72879 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "POST /compute/v2.1/servers/77c3697a-5b72-4f66-9ba0-0fba67484286/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.136185 Aug 27 02:25:51.468071 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 365/743] 10.222.0.61 () {60 vars in 1323 bytes} [Sat Aug 27 02:25:51 2022] POST /compute/v2.1/servers/77c3697a-5b72-4f66-9ba0-0fba67484286/os-volume_attachments => generated 174 bytes in 138 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:25:51.535713 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-575ce893-e6b5-4faa-93bb-a6a3208ab314 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:25:51.536781 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-575ce893-e6b5-4faa-93bb-a6a3208ab314 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: 77c3697a-5b72-4f66-9ba0-0fba67484286] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:25:51.544070 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-575ce893-e6b5-4faa-93bb-a6a3208ab314 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:51.544919 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-575ce893-e6b5-4faa-93bb-a6a3208ab314 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:51.545444 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-575ce893-e6b5-4faa-93bb-a6a3208ab314 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:51.546176 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-575ce893-e6b5-4faa-93bb-a6a3208ab314 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:51.546626 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-575ce893-e6b5-4faa-93bb-a6a3208ab314 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:51.547055 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-575ce893-e6b5-4faa-93bb-a6a3208ab314 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:51.632761 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.objects.instance [None req-575ce893-e6b5-4faa-93bb-a6a3208ab314 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lazy-loading 'services' on Instance uuid 77c3697a-5b72-4f66-9ba0-0fba67484286 {{(pid=120782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:25:51.710093 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-575ce893-e6b5-4faa-93bb-a6a3208ab314 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "DELETE /compute/v2.1/servers/77c3697a-5b72-4f66-9ba0-0fba67484286/os-volume_attachments/82dbb4d8-0d82-48ec-9b9c-1d4c0042fe4b" status: 202 len: 0 microversion: 2.1 time: 0.178156 Aug 27 02:25:51.710688 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 379/744] 10.222.0.61 () {58 vars in 1416 bytes} [Sat Aug 27 02:25:51 2022] DELETE /compute/v2.1/servers/77c3697a-5b72-4f66-9ba0-0fba67484286/os-volume_attachments/82dbb4d8-0d82-48ec-9b9c-1d4c0042fe4b => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:25:51.719642 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-71250b91-4dd8-4349-a4b8-2c1497ac20fd tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:25:51.721968 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-71250b91-4dd8-4349-a4b8-2c1497ac20fd tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: 77c3697a-5b72-4f66-9ba0-0fba67484286] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:25:51.730852 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-71250b91-4dd8-4349-a4b8-2c1497ac20fd tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:51.731340 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-71250b91-4dd8-4349-a4b8-2c1497ac20fd tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:51.731772 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-71250b91-4dd8-4349-a4b8-2c1497ac20fd tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:51.732472 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-71250b91-4dd8-4349-a4b8-2c1497ac20fd tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:51.732923 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-71250b91-4dd8-4349-a4b8-2c1497ac20fd tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:51.733342 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-71250b91-4dd8-4349-a4b8-2c1497ac20fd tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:51.764033 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-71250b91-4dd8-4349-a4b8-2c1497ac20fd tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/77c3697a-5b72-4f66-9ba0-0fba67484286/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048648 Aug 27 02:25:51.764603 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 366/745] 10.222.0.61 () {58 vars in 1302 bytes} [Sat Aug 27 02:25:51 2022] GET /compute/v2.1/servers/77c3697a-5b72-4f66-9ba0-0fba67484286/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:25:52.223015 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-93f0d518-6828-4fce-bbea-22df17d30b5f tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:25:52.223698 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-93f0d518-6828-4fce-bbea-22df17d30b5f tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 9cad910f-6edf-4462-9db0-4e7f0a060620] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:25:52.231688 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-93f0d518-6828-4fce-bbea-22df17d30b5f tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:52.232482 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-93f0d518-6828-4fce-bbea-22df17d30b5f tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:52.233296 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-93f0d518-6828-4fce-bbea-22df17d30b5f tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:52.234602 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-93f0d518-6828-4fce-bbea-22df17d30b5f tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:52.235167 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-93f0d518-6828-4fce-bbea-22df17d30b5f tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:52.235897 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-93f0d518-6828-4fce-bbea-22df17d30b5f tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:52.384404 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-93f0d518-6828-4fce-bbea-22df17d30b5f tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fbea2c71674b239e6d8fba6518e962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d9d02db5c49fda33321f2914a7f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:25:52.393233 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-93f0d518-6828-4fce-bbea-22df17d30b5f tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "GET /compute/v2.1/servers/9cad910f-6edf-4462-9db0-4e7f0a060620" status: 200 len: 1363 microversion: 2.1 time: 0.175316 Aug 27 02:25:52.393962 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 380/746] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:25:52 2022] GET /compute/v2.1/servers/9cad910f-6edf-4462-9db0-4e7f0a060620 => generated 1363 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:25:52.777265 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-cd2de1d0-99ed-4329-9469-45f8d6ecee3a tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:25:52.779631 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-cd2de1d0-99ed-4329-9469-45f8d6ecee3a tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: 77c3697a-5b72-4f66-9ba0-0fba67484286] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:25:52.789097 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-cd2de1d0-99ed-4329-9469-45f8d6ecee3a tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:52.789624 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-cd2de1d0-99ed-4329-9469-45f8d6ecee3a tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:52.790340 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-cd2de1d0-99ed-4329-9469-45f8d6ecee3a tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:52.791009 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-cd2de1d0-99ed-4329-9469-45f8d6ecee3a tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:52.791471 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-cd2de1d0-99ed-4329-9469-45f8d6ecee3a tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:52.792292 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-cd2de1d0-99ed-4329-9469-45f8d6ecee3a tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:52.829800 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-cd2de1d0-99ed-4329-9469-45f8d6ecee3a tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/77c3697a-5b72-4f66-9ba0-0fba67484286/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057002 Aug 27 02:25:52.831708 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 367/747] 10.222.0.61 () {58 vars in 1302 bytes} [Sat Aug 27 02:25:52 2022] GET /compute/v2.1/servers/77c3697a-5b72-4f66-9ba0-0fba67484286/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:25:52.903841 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-db80bbe6-cb95-474f-b0df-85f676756f9a tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:25:52.904669 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-db80bbe6-cb95-474f-b0df-85f676756f9a tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: 77c3697a-5b72-4f66-9ba0-0fba67484286] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:25:52.911442 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-db80bbe6-cb95-474f-b0df-85f676756f9a tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:52.912001 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-db80bbe6-cb95-474f-b0df-85f676756f9a tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:52.912462 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-db80bbe6-cb95-474f-b0df-85f676756f9a tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:52.913145 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-db80bbe6-cb95-474f-b0df-85f676756f9a tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:52.913632 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-db80bbe6-cb95-474f-b0df-85f676756f9a tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:52.914058 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-db80bbe6-cb95-474f-b0df-85f676756f9a tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:52.927893 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [req-8af11bdc-eb64-475c-9a09-955c7f5eefb6 req-c183465f-747a-43e7-ad0d-672aeeb23147 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9cad910f-6edf-4462-9db0-4e7f0a060620", "tag": "431c87b1-a7a6-494e-bce0-cc55b95d52f7"}]} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:25:52.939312 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-8af11bdc-eb64-475c-9a09-955c7f5eefb6 req-c183465f-747a-43e7-ad0d-672aeeb23147 service nova] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:52.940129 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-8af11bdc-eb64-475c-9a09-955c7f5eefb6 req-c183465f-747a-43e7-ad0d-672aeeb23147 service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:52.940750 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-8af11bdc-eb64-475c-9a09-955c7f5eefb6 req-c183465f-747a-43e7-ad0d-672aeeb23147 service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:52.941269 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-db80bbe6-cb95-474f-b0df-85f676756f9a tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: 77c3697a-5b72-4f66-9ba0-0fba67484286] Going to try to terminate instance {{(pid=120782) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:25:52.954741 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.compute.server_external_events [req-8af11bdc-eb64-475c-9a09-955c7f5eefb6 req-c183465f-747a-43e7-ad0d-672aeeb23147 service nova] Creating event network-changed:431c87b1-a7a6-494e-bce0-cc55b95d52f7 for instance 9cad910f-6edf-4462-9db0-4e7f0a060620 on hv-cinder-84630 Aug 27 02:25:52.960070 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [req-8af11bdc-eb64-475c-9a09-955c7f5eefb6 req-c183465f-747a-43e7-ad0d-672aeeb23147 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035963 Aug 27 02:25:52.960659 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 368/748] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Aug 27 02:25:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:25:52.985085 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:25:53.037439 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-db80bbe6-cb95-474f-b0df-85f676756f9a tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "DELETE /compute/v2.1/servers/77c3697a-5b72-4f66-9ba0-0fba67484286" status: 204 len: 0 microversion: 2.1 time: 0.136855 Aug 27 02:25:53.038292 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 381/749] 10.222.0.61 () {58 vars in 1239 bytes} [Sat Aug 27 02:25:52 2022] DELETE /compute/v2.1/servers/77c3697a-5b72-4f66-9ba0-0fba67484286 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:25:53.047211 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-bda6ab70-8aba-44c7-b631-cc24bd241924 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:25:53.048250 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-bda6ab70-8aba-44c7-b631-cc24bd241924 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: 77c3697a-5b72-4f66-9ba0-0fba67484286] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:25:53.054902 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bda6ab70-8aba-44c7-b631-cc24bd241924 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:53.055419 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bda6ab70-8aba-44c7-b631-cc24bd241924 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:53.055849 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bda6ab70-8aba-44c7-b631-cc24bd241924 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:53.056537 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bda6ab70-8aba-44c7-b631-cc24bd241924 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:53.056985 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bda6ab70-8aba-44c7-b631-cc24bd241924 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:53.057420 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bda6ab70-8aba-44c7-b631-cc24bd241924 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:53.193580 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-bda6ab70-8aba-44c7-b631-cc24bd241924 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6f819365574091ae344f14e47f487f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa1c411b57d4e72885dac2b4f4dfe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:25:53.201613 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-bda6ab70-8aba-44c7-b631-cc24bd241924 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/77c3697a-5b72-4f66-9ba0-0fba67484286" status: 200 len: 1684 microversion: 2.1 time: 0.158674 Aug 27 02:25:53.202204 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 369/750] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:25:53 2022] GET /compute/v2.1/servers/77c3697a-5b72-4f66-9ba0-0fba67484286 => generated 1684 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:25:53.414482 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-df8e1015-2dab-439c-a0dc-1a817efd1e70 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:25:53.415169 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-df8e1015-2dab-439c-a0dc-1a817efd1e70 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 9cad910f-6edf-4462-9db0-4e7f0a060620] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:25:53.422822 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-df8e1015-2dab-439c-a0dc-1a817efd1e70 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:53.423483 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-df8e1015-2dab-439c-a0dc-1a817efd1e70 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:53.423914 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-df8e1015-2dab-439c-a0dc-1a817efd1e70 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:53.424599 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-df8e1015-2dab-439c-a0dc-1a817efd1e70 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:53.425045 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-df8e1015-2dab-439c-a0dc-1a817efd1e70 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:53.425486 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-df8e1015-2dab-439c-a0dc-1a817efd1e70 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:53.563788 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-df8e1015-2dab-439c-a0dc-1a817efd1e70 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fbea2c71674b239e6d8fba6518e962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d9d02db5c49fda33321f2914a7f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:25:53.571876 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-df8e1015-2dab-439c-a0dc-1a817efd1e70 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "GET /compute/v2.1/servers/9cad910f-6edf-4462-9db0-4e7f0a060620" status: 200 len: 1363 microversion: 2.1 time: 0.161717 Aug 27 02:25:53.572434 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 382/751] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:25:53 2022] GET /compute/v2.1/servers/9cad910f-6edf-4462-9db0-4e7f0a060620 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:25:54.223118 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-89e35d1f-055d-4210-b0d2-a380b8b7f76a tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:25:54.224022 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-89e35d1f-055d-4210-b0d2-a380b8b7f76a tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: 77c3697a-5b72-4f66-9ba0-0fba67484286] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:25:54.230697 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-89e35d1f-055d-4210-b0d2-a380b8b7f76a tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:54.231316 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-89e35d1f-055d-4210-b0d2-a380b8b7f76a tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:54.231816 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-89e35d1f-055d-4210-b0d2-a380b8b7f76a tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:54.232591 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-89e35d1f-055d-4210-b0d2-a380b8b7f76a tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:54.233163 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-89e35d1f-055d-4210-b0d2-a380b8b7f76a tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:54.233852 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-89e35d1f-055d-4210-b0d2-a380b8b7f76a tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:54.252142 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-12ef19b9-c3ec-499f-aaba-0778b468b464 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:25:54.253143 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-12ef19b9-c3ec-499f-aaba-0778b468b464 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 1b9390be-aab0-4240-83d9-0f815f094605] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:25:54.258596 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-12ef19b9-c3ec-499f-aaba-0778b468b464 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:54.259082 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-12ef19b9-c3ec-499f-aaba-0778b468b464 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:54.259510 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-12ef19b9-c3ec-499f-aaba-0778b468b464 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:54.260201 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-12ef19b9-c3ec-499f-aaba-0778b468b464 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:54.260651 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-12ef19b9-c3ec-499f-aaba-0778b468b464 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:54.261074 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-12ef19b9-c3ec-499f-aaba-0778b468b464 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:54.349176 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.objects.instance [None req-12ef19b9-c3ec-499f-aaba-0778b468b464 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lazy-loading 'services' on Instance uuid 1b9390be-aab0-4240-83d9-0f815f094605 {{(pid=120782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:25:54.365796 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-89e35d1f-055d-4210-b0d2-a380b8b7f76a tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6f819365574091ae344f14e47f487f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa1c411b57d4e72885dac2b4f4dfe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:25:54.374645 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-89e35d1f-055d-4210-b0d2-a380b8b7f76a tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/77c3697a-5b72-4f66-9ba0-0fba67484286" status: 200 len: 1684 microversion: 2.1 time: 0.155323 Aug 27 02:25:54.375327 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 370/752] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:25:54 2022] GET /compute/v2.1/servers/77c3697a-5b72-4f66-9ba0-0fba67484286 => generated 1684 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:25:54.422230 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-12ef19b9-c3ec-499f-aaba-0778b468b464 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "DELETE /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605/os-volume_attachments/614bb599-3532-4c25-b75a-988e7b9264ac" status: 202 len: 0 microversion: 2.1 time: 0.173680 Aug 27 02:25:54.422856 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 383/753] 10.222.0.61 () {58 vars in 1416 bytes} [Sat Aug 27 02:25:54 2022] DELETE /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605/os-volume_attachments/614bb599-3532-4c25-b75a-988e7b9264ac => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 02:25:54.431356 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-0f15f329-7300-4b06-bb15-8d36858421f7 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:25:54.433591 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-0f15f329-7300-4b06-bb15-8d36858421f7 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 1b9390be-aab0-4240-83d9-0f815f094605] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:25:54.440768 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0f15f329-7300-4b06-bb15-8d36858421f7 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:54.441257 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0f15f329-7300-4b06-bb15-8d36858421f7 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:54.441741 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0f15f329-7300-4b06-bb15-8d36858421f7 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:54.442439 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0f15f329-7300-4b06-bb15-8d36858421f7 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:54.442931 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0f15f329-7300-4b06-bb15-8d36858421f7 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:54.443384 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0f15f329-7300-4b06-bb15-8d36858421f7 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:54.473186 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-0f15f329-7300-4b06-bb15-8d36858421f7 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045851 Aug 27 02:25:54.473773 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 371/754] 10.222.0.61 () {58 vars in 1302 bytes} [Sat Aug 27 02:25:54 2022] GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:25:54.593649 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-eeb17603-4437-400f-98e6-20a03c96f650 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:25:54.594478 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-eeb17603-4437-400f-98e6-20a03c96f650 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 9cad910f-6edf-4462-9db0-4e7f0a060620] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:25:54.601825 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-eeb17603-4437-400f-98e6-20a03c96f650 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:54.602308 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-eeb17603-4437-400f-98e6-20a03c96f650 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:54.602742 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-eeb17603-4437-400f-98e6-20a03c96f650 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:54.603425 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-eeb17603-4437-400f-98e6-20a03c96f650 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:54.603883 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-eeb17603-4437-400f-98e6-20a03c96f650 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:54.604302 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-eeb17603-4437-400f-98e6-20a03c96f650 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:54.739961 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-eeb17603-4437-400f-98e6-20a03c96f650 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fbea2c71674b239e6d8fba6518e962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d9d02db5c49fda33321f2914a7f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:25:54.748023 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-eeb17603-4437-400f-98e6-20a03c96f650 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "GET /compute/v2.1/servers/9cad910f-6edf-4462-9db0-4e7f0a060620" status: 200 len: 1363 microversion: 2.1 time: 0.158702 Aug 27 02:25:54.748725 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 384/755] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:25:54 2022] GET /compute/v2.1/servers/9cad910f-6edf-4462-9db0-4e7f0a060620 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:25:55.487460 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-e637a36f-c7db-48b8-9e13-62e6fa93d067 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:25:55.490514 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-e637a36f-c7db-48b8-9e13-62e6fa93d067 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 1b9390be-aab0-4240-83d9-0f815f094605] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:25:55.496849 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e637a36f-c7db-48b8-9e13-62e6fa93d067 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:55.497448 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e637a36f-c7db-48b8-9e13-62e6fa93d067 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:55.497954 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e637a36f-c7db-48b8-9e13-62e6fa93d067 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:55.498762 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e637a36f-c7db-48b8-9e13-62e6fa93d067 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:55.499424 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e637a36f-c7db-48b8-9e13-62e6fa93d067 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:55.499886 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e637a36f-c7db-48b8-9e13-62e6fa93d067 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:55.534612 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-e637a36f-c7db-48b8-9e13-62e6fa93d067 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051981 Aug 27 02:25:55.535693 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 385/756] 10.222.0.61 () {58 vars in 1302 bytes} [Sat Aug 27 02:25:55 2022] GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:25:55.546486 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-104ced27-3477-4cef-bd5e-ce419a0315d7 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:25:55.547205 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-104ced27-3477-4cef-bd5e-ce419a0315d7 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: 77c3697a-5b72-4f66-9ba0-0fba67484286] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:25:55.554914 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-104ced27-3477-4cef-bd5e-ce419a0315d7 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:55.555402 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-104ced27-3477-4cef-bd5e-ce419a0315d7 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:55.555825 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-104ced27-3477-4cef-bd5e-ce419a0315d7 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:55.556750 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-104ced27-3477-4cef-bd5e-ce419a0315d7 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:55.557192 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-104ced27-3477-4cef-bd5e-ce419a0315d7 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:55.557634 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-104ced27-3477-4cef-bd5e-ce419a0315d7 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:55.768606 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-5dfea853-31ed-46a9-82a5-2ca26cc1536a tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:25:55.769455 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-5dfea853-31ed-46a9-82a5-2ca26cc1536a tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 9cad910f-6edf-4462-9db0-4e7f0a060620] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:25:55.777042 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5dfea853-31ed-46a9-82a5-2ca26cc1536a tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:55.777568 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5dfea853-31ed-46a9-82a5-2ca26cc1536a tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:55.777997 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5dfea853-31ed-46a9-82a5-2ca26cc1536a tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:55.778708 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5dfea853-31ed-46a9-82a5-2ca26cc1536a tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:55.779158 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5dfea853-31ed-46a9-82a5-2ca26cc1536a tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:55.779580 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5dfea853-31ed-46a9-82a5-2ca26cc1536a tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:55.798768 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-104ced27-3477-4cef-bd5e-ce419a0315d7 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6f819365574091ae344f14e47f487f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa1c411b57d4e72885dac2b4f4dfe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:25:55.807808 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-104ced27-3477-4cef-bd5e-ce419a0315d7 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/77c3697a-5b72-4f66-9ba0-0fba67484286" status: 200 len: 1684 microversion: 2.1 time: 0.415298 Aug 27 02:25:55.808694 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 372/757] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:25:55 2022] GET /compute/v2.1/servers/77c3697a-5b72-4f66-9ba0-0fba67484286 => generated 1684 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:25:55.927521 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-5dfea853-31ed-46a9-82a5-2ca26cc1536a tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fbea2c71674b239e6d8fba6518e962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d9d02db5c49fda33321f2914a7f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:25:55.936156 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-5dfea853-31ed-46a9-82a5-2ca26cc1536a tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "GET /compute/v2.1/servers/9cad910f-6edf-4462-9db0-4e7f0a060620" status: 200 len: 1363 microversion: 2.1 time: 0.171695 Aug 27 02:25:55.936921 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 386/758] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:25:55 2022] GET /compute/v2.1/servers/9cad910f-6edf-4462-9db0-4e7f0a060620 => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:25:56.451314 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [req-03ca2a59-a3a2-4a95-95fc-965f3ee8859d req-b9cb1280-92f8-4372-9f12-fa79eed57215 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77c3697a-5b72-4f66-9ba0-0fba67484286", "name": "network-vif-deleted", "tag": "0920aabe-2380-40e3-a6ac-3334ec3130a5"}]} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:25:56.461797 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-03ca2a59-a3a2-4a95-95fc-965f3ee8859d req-b9cb1280-92f8-4372-9f12-fa79eed57215 service nova] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:56.462369 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-03ca2a59-a3a2-4a95-95fc-965f3ee8859d req-b9cb1280-92f8-4372-9f12-fa79eed57215 service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:56.462801 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-03ca2a59-a3a2-4a95-95fc-965f3ee8859d req-b9cb1280-92f8-4372-9f12-fa79eed57215 service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:56.474368 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.compute.server_external_events [req-03ca2a59-a3a2-4a95-95fc-965f3ee8859d req-b9cb1280-92f8-4372-9f12-fa79eed57215 service nova] Creating event network-vif-deleted:0920aabe-2380-40e3-a6ac-3334ec3130a5 for instance 77c3697a-5b72-4f66-9ba0-0fba67484286 on hv-cinder-84630 Aug 27 02:25:56.479594 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [req-03ca2a59-a3a2-4a95-95fc-965f3ee8859d req-b9cb1280-92f8-4372-9f12-fa79eed57215 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032029 Aug 27 02:25:56.480760 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 373/759] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Aug 27 02:25:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:25:56.548406 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-ec89b37c-d03e-462b-8dae-daf5cf0f6c6a tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:25:56.550846 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-ec89b37c-d03e-462b-8dae-daf5cf0f6c6a tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 1b9390be-aab0-4240-83d9-0f815f094605] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:25:56.558041 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ec89b37c-d03e-462b-8dae-daf5cf0f6c6a tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:56.558797 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ec89b37c-d03e-462b-8dae-daf5cf0f6c6a tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:56.559407 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ec89b37c-d03e-462b-8dae-daf5cf0f6c6a tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:56.560254 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ec89b37c-d03e-462b-8dae-daf5cf0f6c6a tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:56.561096 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ec89b37c-d03e-462b-8dae-daf5cf0f6c6a tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:56.561859 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ec89b37c-d03e-462b-8dae-daf5cf0f6c6a tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:56.624007 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-ec89b37c-d03e-462b-8dae-daf5cf0f6c6a tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079832 Aug 27 02:25:56.625257 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 387/760] 10.222.0.61 () {58 vars in 1302 bytes} [Sat Aug 27 02:25:56 2022] GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:25:56.832106 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-b0208c8c-1a68-4bae-8dda-f62523c4e45b tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:25:56.834210 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-b0208c8c-1a68-4bae-8dda-f62523c4e45b tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: 77c3697a-5b72-4f66-9ba0-0fba67484286] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:25:56.842635 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b0208c8c-1a68-4bae-8dda-f62523c4e45b tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:56.843636 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b0208c8c-1a68-4bae-8dda-f62523c4e45b tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:56.844353 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b0208c8c-1a68-4bae-8dda-f62523c4e45b tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:56.845443 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b0208c8c-1a68-4bae-8dda-f62523c4e45b tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:56.846112 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b0208c8c-1a68-4bae-8dda-f62523c4e45b tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:56.846734 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b0208c8c-1a68-4bae-8dda-f62523c4e45b tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:56.901272 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b0208c8c-1a68-4bae-8dda-f62523c4e45b tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:56.901840 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b0208c8c-1a68-4bae-8dda-f62523c4e45b tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:56.902513 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b0208c8c-1a68-4bae-8dda-f62523c4e45b tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:56.903343 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.objects.instance [None req-b0208c8c-1a68-4bae-8dda-f62523c4e45b tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lazy-loading 'fault' on Instance uuid 77c3697a-5b72-4f66-9ba0-0fba67484286 {{(pid=120783) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:25:56.965142 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-bf7d51f1-6d82-4a15-89b2-06fdb61832f9 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:25:56.965780 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-bf7d51f1-6d82-4a15-89b2-06fdb61832f9 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 9cad910f-6edf-4462-9db0-4e7f0a060620] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:25:56.976788 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-bf7d51f1-6d82-4a15-89b2-06fdb61832f9 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:56.978585 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-bf7d51f1-6d82-4a15-89b2-06fdb61832f9 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:56.984310 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-bf7d51f1-6d82-4a15-89b2-06fdb61832f9 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:56.987666 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-bf7d51f1-6d82-4a15-89b2-06fdb61832f9 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:56.994032 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-bf7d51f1-6d82-4a15-89b2-06fdb61832f9 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:56.994742 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-bf7d51f1-6d82-4a15-89b2-06fdb61832f9 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:57.020015 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-b0208c8c-1a68-4bae-8dda-f62523c4e45b tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6f819365574091ae344f14e47f487f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa1c411b57d4e72885dac2b4f4dfe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:25:57.035473 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-b0208c8c-1a68-4bae-8dda-f62523c4e45b tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/77c3697a-5b72-4f66-9ba0-0fba67484286" status: 200 len: 1332 microversion: 2.1 time: 0.208905 Aug 27 02:25:57.050243 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 374/761] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:25:56 2022] GET /compute/v2.1/servers/77c3697a-5b72-4f66-9ba0-0fba67484286 => generated 1332 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:25:57.214811 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-bf7d51f1-6d82-4a15-89b2-06fdb61832f9 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fbea2c71674b239e6d8fba6518e962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d9d02db5c49fda33321f2914a7f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:25:57.228200 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-bf7d51f1-6d82-4a15-89b2-06fdb61832f9 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "GET /compute/v2.1/servers/9cad910f-6edf-4462-9db0-4e7f0a060620" status: 200 len: 1363 microversion: 2.1 time: 0.269453 Aug 27 02:25:57.230298 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 388/762] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:25:56 2022] GET /compute/v2.1/servers/9cad910f-6edf-4462-9db0-4e7f0a060620 => generated 1363 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:25:57.645023 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-9f6f1307-95b2-4658-b2f1-e8d2ac196079 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:25:57.650124 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-9f6f1307-95b2-4658-b2f1-e8d2ac196079 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 1b9390be-aab0-4240-83d9-0f815f094605] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:25:57.656767 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9f6f1307-95b2-4658-b2f1-e8d2ac196079 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:57.657264 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9f6f1307-95b2-4658-b2f1-e8d2ac196079 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:57.657727 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9f6f1307-95b2-4658-b2f1-e8d2ac196079 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:57.658643 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9f6f1307-95b2-4658-b2f1-e8d2ac196079 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:57.659137 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9f6f1307-95b2-4658-b2f1-e8d2ac196079 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:57.659562 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9f6f1307-95b2-4658-b2f1-e8d2ac196079 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:57.697202 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-9f6f1307-95b2-4658-b2f1-e8d2ac196079 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.060965 Aug 27 02:25:57.697910 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 375/763] 10.222.0.61 () {58 vars in 1302 bytes} [Sat Aug 27 02:25:57 2022] GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:25:57.779693 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-be6a9435-a5b4-499d-a4d5-3a28a80f9e53 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:25:57.780191 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-be6a9435-a5b4-499d-a4d5-3a28a80f9e53 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 1b9390be-aab0-4240-83d9-0f815f094605] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:25:57.787901 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-be6a9435-a5b4-499d-a4d5-3a28a80f9e53 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:57.788649 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-be6a9435-a5b4-499d-a4d5-3a28a80f9e53 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:57.789249 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-be6a9435-a5b4-499d-a4d5-3a28a80f9e53 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:57.790001 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-be6a9435-a5b4-499d-a4d5-3a28a80f9e53 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:57.790444 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-be6a9435-a5b4-499d-a4d5-3a28a80f9e53 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:57.790860 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-be6a9435-a5b4-499d-a4d5-3a28a80f9e53 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:57.823303 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-be6a9435-a5b4-499d-a4d5-3a28a80f9e53 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 1b9390be-aab0-4240-83d9-0f815f094605] Going to try to terminate instance {{(pid=120782) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:25:57.907152 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-be6a9435-a5b4-499d-a4d5-3a28a80f9e53 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "DELETE /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605" status: 204 len: 0 microversion: 2.1 time: 0.131305 Aug 27 02:25:57.907751 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 389/764] 10.222.0.61 () {58 vars in 1239 bytes} [Sat Aug 27 02:25:57 2022] DELETE /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:25:57.916253 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-efa682ec-37b0-44e0-8747-1fb3dc1ffdd2 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:25:57.916864 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-efa682ec-37b0-44e0-8747-1fb3dc1ffdd2 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 1b9390be-aab0-4240-83d9-0f815f094605] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:25:57.923271 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-efa682ec-37b0-44e0-8747-1fb3dc1ffdd2 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:57.923769 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-efa682ec-37b0-44e0-8747-1fb3dc1ffdd2 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:57.924199 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-efa682ec-37b0-44e0-8747-1fb3dc1ffdd2 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:57.924895 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-efa682ec-37b0-44e0-8747-1fb3dc1ffdd2 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:57.925346 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-efa682ec-37b0-44e0-8747-1fb3dc1ffdd2 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:57.925805 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-efa682ec-37b0-44e0-8747-1fb3dc1ffdd2 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:58.057452 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-72f4e32b-4f14-4948-9ae7-0a5fc54ab24b tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:25:58.058318 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-72f4e32b-4f14-4948-9ae7-0a5fc54ab24b tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: 77c3697a-5b72-4f66-9ba0-0fba67484286] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:25:58.064869 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-efa682ec-37b0-44e0-8747-1fb3dc1ffdd2 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:25:58.065389 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-72f4e32b-4f14-4948-9ae7-0a5fc54ab24b tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:58.065920 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-72f4e32b-4f14-4948-9ae7-0a5fc54ab24b tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:58.066328 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-72f4e32b-4f14-4948-9ae7-0a5fc54ab24b tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:58.067056 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-72f4e32b-4f14-4948-9ae7-0a5fc54ab24b tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:58.067506 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-72f4e32b-4f14-4948-9ae7-0a5fc54ab24b tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:58.067925 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-72f4e32b-4f14-4948-9ae7-0a5fc54ab24b tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:58.073077 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-efa682ec-37b0-44e0-8747-1fb3dc1ffdd2 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605" status: 200 len: 1688 microversion: 2.1 time: 0.160807 Aug 27 02:25:58.073692 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 376/765] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:25:57 2022] GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605 => generated 1688 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:25:58.081870 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.wsgi [None req-72f4e32b-4f14-4948-9ae7-0a5fc54ab24b tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] HTTP exception thrown: Instance 77c3697a-5b72-4f66-9ba0-0fba67484286 could not be found. Aug 27 02:25:58.083609 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-72f4e32b-4f14-4948-9ae7-0a5fc54ab24b tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Request method failure captured: Aug 27 02:25:58.083609 dv-cinder-846303-3-smb devstack@n-api.service[120782]: request: GET /compute/v2.1/servers/77c3697a-5b72-4f66-9ba0-0fba67484286 HTTP/1.1 Aug 27 02:25:58.083609 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Accept: application/json Aug 27 02:25:58.083609 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Accept-Encoding: identity Aug 27 02:25:58.083609 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Connection: close Aug 27 02:25:58.083609 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Content-Length: 0 Aug 27 02:25:58.083609 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Content-Type: application/json Aug 27 02:25:58.083609 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Host: 10.222.0.61 Aug 27 02:25:58.083609 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Openstack-System-Scope: None Aug 27 02:25:58.083609 dv-cinder-846303-3-smb devstack@n-api.service[120782]: User-Agent: python-urllib3/1.26.11 Aug 27 02:25:58.083609 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Auth-Token: gAAAAABjCX-GZMxBoDm0UEKrtF9w1zn8zf5k_pRKs9w1w8QBRmamyePi9gdcvRwYzK044f89BKz1wZ6FALfNLv1C6uDnz_VZDZcPY_z2HcyDI5nmMGMvL5rG2v4zh3O1IrszVG_kNPPcMoviX7QaOQhXuRqD1X6DsEJwS6gyWrQ-SPSaYeWVQOw Aug 27 02:25:58.083609 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Domain-Id: None Aug 27 02:25:58.083609 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Domain-Name: None Aug 27 02:25:58.083609 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Identity-Status: Confirmed Aug 27 02:25:58.083609 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Is-Admin-Project: True Aug 27 02:25:58.083609 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Domain-Id: default Aug 27 02:25:58.083609 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Domain-Name: Default Aug 27 02:25:58.083609 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Id: 8aa1c411b57d4e72885dac2b4f4dfe7a Aug 27 02:25:58.083609 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Name: tempest-AttachVolumeNegativeTest-799378516 Aug 27 02:25:58.083609 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Role: member,reader Aug 27 02:25:58.083609 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Roles: member,reader Aug 27 02:25:58.085170 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/8aa1c411b57d4e72885dac2b4f4dfe7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_8aa1c411b57d4e72885dac2b4f4dfe7a", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8aa1c411b57d4e72885dac2b4f4dfe7a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8aa1c411b57d4e72885dac2b4f4dfe7a"}]}] Aug 27 02:25:58.085170 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Tenant: tempest-AttachVolumeNegativeTest-799378516 Aug 27 02:25:58.085170 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Tenant-Id: 8aa1c411b57d4e72885dac2b4f4dfe7a Aug 27 02:25:58.085170 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-799378516 Aug 27 02:25:58.085170 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User: tempest-AttachVolumeNegativeTest-799378516-project Aug 27 02:25:58.085170 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Domain-Id: default Aug 27 02:25:58.085170 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Domain-Name: Default Aug 27 02:25:58.085170 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Id: 4a6f819365574091ae344f14e47f487f Aug 27 02:25:58.085170 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Name: tempest-AttachVolumeNegativeTest-799378516-project Aug 27 02:25:58.085170 dv-cinder-846303-3-smb devstack@n-api.service[120782]: method: > Aug 27 02:25:58.085170 dv-cinder-846303-3-smb devstack@n-api.service[120782]: exception: Instance 77c3697a-5b72-4f66-9ba0-0fba67484286 could not be found. Aug 27 02:25:58.085170 dv-cinder-846303-3-smb devstack@n-api.service[120782]: action_args: {'id': '77c3697a-5b72-4f66-9ba0-0fba67484286'} Aug 27 02:25:58.085995 dv-cinder-846303-3-smb devstack@n-api.service[120782]: {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:25:58.085995 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:25:58.085995 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:25:58.085995 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:25:58.085995 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:25:58.085995 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:25:58.085995 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:25:58.085995 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:25:58.085995 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:25:58.085995 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:25:58.085995 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77c3697a-5b72-4f66-9ba0-0fba67484286 could not be found. Aug 27 02:25:58.085995 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:25:58.085995 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:25:58.085995 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:25:58.085995 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:25:58.085995 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:25:58.085995 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:25:58.085995 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:25:58.085995 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:25:58.085995 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:25:58.087210 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:25:58.087210 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:25:58.087210 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:25:58.087210 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:25:58.087210 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:25:58.087210 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:25:58.087210 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:25:58.087210 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77c3697a-5b72-4f66-9ba0-0fba67484286 could not be found. Aug 27 02:25:58.087210 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:25:58.087210 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:25:58.087210 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:25:58.087210 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:25:58.087210 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:25:58.087210 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:25:58.087210 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:25:58.087210 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:25:58.087210 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77c3697a-5b72-4f66-9ba0-0fba67484286 could not be found. Aug 27 02:25:58.087210 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:25:58.088289 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-72f4e32b-4f14-4948-9ae7-0a5fc54ab24b tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Returning 404 to user: Instance 77c3697a-5b72-4f66-9ba0-0fba67484286 could not be found. {{(pid=120782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:25:58.088289 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-72f4e32b-4f14-4948-9ae7-0a5fc54ab24b tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/77c3697a-5b72-4f66-9ba0-0fba67484286" status: 404 len: 111 microversion: 2.1 time: 0.032207 Aug 27 02:25:58.088289 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 390/766] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:25:58 2022] GET /compute/v2.1/servers/77c3697a-5b72-4f66-9ba0-0fba67484286 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:25:58.094199 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-ee020aa5-eff9-456d-aac2-d7c034406b5b tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '.version_select at 0x7fd808219310>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:25:58.115007 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-ee020aa5-eff9-456d-aac2-d7c034406b5b tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1006882662" status: 202 len: 0 microversion: 2.1 time: 0.024637 Aug 27 02:25:58.115660 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 377/767] 10.222.0.61 () {58 vars in 1221 bytes} [Sat Aug 27 02:25:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1006882662 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:25:58.252387 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-f213ac92-5a8b-4c77-bc6c-ac04c54b716e tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:25:58.253150 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-f213ac92-5a8b-4c77-bc6c-ac04c54b716e tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 9cad910f-6edf-4462-9db0-4e7f0a060620] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:25:58.259628 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f213ac92-5a8b-4c77-bc6c-ac04c54b716e tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:58.260173 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f213ac92-5a8b-4c77-bc6c-ac04c54b716e tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:58.260798 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f213ac92-5a8b-4c77-bc6c-ac04c54b716e tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:58.261559 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f213ac92-5a8b-4c77-bc6c-ac04c54b716e tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:58.262158 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f213ac92-5a8b-4c77-bc6c-ac04c54b716e tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:58.262927 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f213ac92-5a8b-4c77-bc6c-ac04c54b716e tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:58.419723 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-f213ac92-5a8b-4c77-bc6c-ac04c54b716e tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fbea2c71674b239e6d8fba6518e962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d9d02db5c49fda33321f2914a7f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:25:58.428229 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-f213ac92-5a8b-4c77-bc6c-ac04c54b716e tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "GET /compute/v2.1/servers/9cad910f-6edf-4462-9db0-4e7f0a060620" status: 200 len: 1363 microversion: 2.1 time: 0.179787 Aug 27 02:25:58.428781 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 391/768] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:25:58 2022] GET /compute/v2.1/servers/9cad910f-6edf-4462-9db0-4e7f0a060620 => generated 1363 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:25:58.740932 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell0:SELECT=2 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:25:58.745544 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-33d6ae7d-bccf-463e-bbbd-87bdd930c4fe tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Action: 'create', calling method: .version_select at 0x7fd8084cfaf0>, body: {"keypair": {"name": "tempest-keypair-1347803859", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJ8eqZcyXPR+TuX32nZmSx2KHzmV9nWlYgRsQ1bfuG6+Ac1b/dz5vSx22++ZlMAsXYQw+bc6y9+ADxZl9Gip3WEv9BzIAd5XfEuxxeaovhQFbm2hpCXVsblFEgTHoa+YA=="}} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:25:58.762058 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.quota [None req-33d6ae7d-bccf-463e-bbbd-87bdd930c4fe tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Getting quotas for project 8aa1c411b57d4e72885dac2b4f4dfe7a. Resources: {'key_pairs'} {{(pid=120783) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:25:58.766234 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.quota [None req-33d6ae7d-bccf-463e-bbbd-87bdd930c4fe tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Getting quotas for user 4a6f819365574091ae344f14e47f487f and project 8aa1c411b57d4e72885dac2b4f4dfe7a. Resources: {'key_pairs'} {{(pid=120783) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:25:58.789946 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-33d6ae7d-bccf-463e-bbbd-87bdd930c4fe tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.050376 Aug 27 02:25:58.790540 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 378/769] 10.222.0.61 () {60 vars in 1159 bytes} [Sat Aug 27 02:25:58 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:25:59.094292 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [req-924073cb-39e1-4381-97a3-f5e8a4bd7fec req-eb54b4f2-3c97-4fe3-8664-42408e1ce9fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9cad910f-6edf-4462-9db0-4e7f0a060620", "name": "network-vif-plugged", "status": "completed", "tag": "431c87b1-a7a6-494e-bce0-cc55b95d52f7"}]} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:25:59.097082 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-15375499-d5f4-4e37-81f5-0a4d8bec6c4c tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:25:59.097984 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-15375499-d5f4-4e37-81f5-0a4d8bec6c4c tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 1b9390be-aab0-4240-83d9-0f815f094605] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:25:59.106711 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-15375499-d5f4-4e37-81f5-0a4d8bec6c4c tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:59.107432 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-15375499-d5f4-4e37-81f5-0a4d8bec6c4c tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:59.107982 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-15375499-d5f4-4e37-81f5-0a4d8bec6c4c tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:59.109172 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-15375499-d5f4-4e37-81f5-0a4d8bec6c4c tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:59.109754 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-15375499-d5f4-4e37-81f5-0a4d8bec6c4c tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:59.110272 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-15375499-d5f4-4e37-81f5-0a4d8bec6c4c tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:59.112770 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-924073cb-39e1-4381-97a3-f5e8a4bd7fec req-eb54b4f2-3c97-4fe3-8664-42408e1ce9fd service nova] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:59.113216 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-924073cb-39e1-4381-97a3-f5e8a4bd7fec req-eb54b4f2-3c97-4fe3-8664-42408e1ce9fd service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:59.113951 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-924073cb-39e1-4381-97a3-f5e8a4bd7fec req-eb54b4f2-3c97-4fe3-8664-42408e1ce9fd service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:59.126903 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.compute.server_external_events [req-924073cb-39e1-4381-97a3-f5e8a4bd7fec req-eb54b4f2-3c97-4fe3-8664-42408e1ce9fd service nova] Creating event network-vif-plugged:431c87b1-a7a6-494e-bce0-cc55b95d52f7 for instance 9cad910f-6edf-4462-9db0-4e7f0a060620 on hv-cinder-84630 Aug 27 02:25:59.132473 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [req-924073cb-39e1-4381-97a3-f5e8a4bd7fec req-eb54b4f2-3c97-4fe3-8664-42408e1ce9fd service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043478 Aug 27 02:25:59.133624 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 392/770] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Aug 27 02:25:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:25:59.265846 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-15375499-d5f4-4e37-81f5-0a4d8bec6c4c tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:25:59.273813 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-15375499-d5f4-4e37-81f5-0a4d8bec6c4c tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605" status: 200 len: 1688 microversion: 2.1 time: 0.182954 Aug 27 02:25:59.274528 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 379/771] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:25:59 2022] GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605 => generated 1688 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:25:59.449291 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-a6d1cbc9-c7bb-4a8b-8ff4-c7ed7e0a3a89 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:25:59.450026 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-a6d1cbc9-c7bb-4a8b-8ff4-c7ed7e0a3a89 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 9cad910f-6edf-4462-9db0-4e7f0a060620] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:25:59.456842 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a6d1cbc9-c7bb-4a8b-8ff4-c7ed7e0a3a89 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:59.457327 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a6d1cbc9-c7bb-4a8b-8ff4-c7ed7e0a3a89 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:59.457793 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a6d1cbc9-c7bb-4a8b-8ff4-c7ed7e0a3a89 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:59.458533 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a6d1cbc9-c7bb-4a8b-8ff4-c7ed7e0a3a89 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:59.459029 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a6d1cbc9-c7bb-4a8b-8ff4-c7ed7e0a3a89 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:59.459449 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a6d1cbc9-c7bb-4a8b-8ff4-c7ed7e0a3a89 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:59.659362 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-a6d1cbc9-c7bb-4a8b-8ff4-c7ed7e0a3a89 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fbea2c71674b239e6d8fba6518e962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d9d02db5c49fda33321f2914a7f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:25:59.667623 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-a6d1cbc9-c7bb-4a8b-8ff4-c7ed7e0a3a89 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "GET /compute/v2.1/servers/9cad910f-6edf-4462-9db0-4e7f0a060620" status: 200 len: 1363 microversion: 2.1 time: 0.222817 Aug 27 02:25:59.668279 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 393/772] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:25:59 2022] GET /compute/v2.1/servers/9cad910f-6edf-4462-9db0-4e7f0a060620 => generated 1363 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:26:00.188238 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-60acd7f2-67a7-44f8-b375-42417b391bb7 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1828167554", "imageRef": "7d45cdd6-750f-40c7-9475-f7bf12fcb204", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0a6b16e1-c045-4fdd-a4f5-57e1f8fdda65"}], "security_groups": [{"name": "tempest-securitygroup--1721757834"}], "key_name": "tempest-keypair-1347803859", "user_data": "}} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:26:00.292523 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.network.neutron [None req-60acd7f2-67a7-44f8-b375-42417b391bb7 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] validate_networks() for [('0a6b16e1-c045-4fdd-a4f5-57e1f8fdda65', None, None, None, None, None)] {{(pid=120783) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:26:00.296160 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-5152f961-dbef-4e22-b350-2de0fc98a0e4 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:26:00.296985 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-5152f961-dbef-4e22-b350-2de0fc98a0e4 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 1b9390be-aab0-4240-83d9-0f815f094605] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:26:00.304932 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5152f961-dbef-4e22-b350-2de0fc98a0e4 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:00.305481 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5152f961-dbef-4e22-b350-2de0fc98a0e4 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:00.305995 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5152f961-dbef-4e22-b350-2de0fc98a0e4 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:00.306619 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5152f961-dbef-4e22-b350-2de0fc98a0e4 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:00.307219 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5152f961-dbef-4e22-b350-2de0fc98a0e4 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:00.307639 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5152f961-dbef-4e22-b350-2de0fc98a0e4 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:00.458264 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-5152f961-dbef-4e22-b350-2de0fc98a0e4 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:00.466694 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-5152f961-dbef-4e22-b350-2de0fc98a0e4 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605" status: 200 len: 1688 microversion: 2.1 time: 0.174988 Aug 27 02:26:00.467300 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 394/773] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:26:00 2022] GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605 => generated 1688 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:26:00.689203 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-cdabbe93-583b-4e04-a81b-8a36eb854b06 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:26:00.689945 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-cdabbe93-583b-4e04-a81b-8a36eb854b06 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 9cad910f-6edf-4462-9db0-4e7f0a060620] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:26:00.696469 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cdabbe93-583b-4e04-a81b-8a36eb854b06 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:00.696962 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cdabbe93-583b-4e04-a81b-8a36eb854b06 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:00.697433 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cdabbe93-583b-4e04-a81b-8a36eb854b06 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:00.698135 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cdabbe93-583b-4e04-a81b-8a36eb854b06 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:00.698593 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cdabbe93-583b-4e04-a81b-8a36eb854b06 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:00.699023 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cdabbe93-583b-4e04-a81b-8a36eb854b06 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:00.729432 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.virt.hardware [None req-60acd7f2-67a7-44f8-b375-42417b391bb7 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Flavor limits 0:0:0 {{(pid=120783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:26:00.729856 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.virt.hardware [None req-60acd7f2-67a7-44f8-b375-42417b391bb7 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Image limits 0:0:0 {{(pid=120783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:26:00.730511 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.virt.hardware [None req-60acd7f2-67a7-44f8-b375-42417b391bb7 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Flavor pref 0:0:0 {{(pid=120783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:26:00.730916 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.virt.hardware [None req-60acd7f2-67a7-44f8-b375-42417b391bb7 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Image pref 0:0:0 {{(pid=120783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:26:00.731435 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.virt.hardware [None req-60acd7f2-67a7-44f8-b375-42417b391bb7 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:26:00.740782 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-60acd7f2-67a7-44f8-b375-42417b391bb7 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:00.741265 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-60acd7f2-67a7-44f8-b375-42417b391bb7 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:00.741735 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-60acd7f2-67a7-44f8-b375-42417b391bb7 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:00.742465 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-60acd7f2-67a7-44f8-b375-42417b391bb7 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:00.742923 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-60acd7f2-67a7-44f8-b375-42417b391bb7 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:00.743344 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-60acd7f2-67a7-44f8-b375-42417b391bb7 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:00.750541 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell1:SELECT=100 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:26:00.762801 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.quota [None req-60acd7f2-67a7-44f8-b375-42417b391bb7 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Getting quotas for project 8aa1c411b57d4e72885dac2b4f4dfe7a. Resources: {'instances', 'ram', 'cores'} {{(pid=120783) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:26:00.767288 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.quota [None req-60acd7f2-67a7-44f8-b375-42417b391bb7 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Getting quotas for user 4a6f819365574091ae344f14e47f487f and project 8aa1c411b57d4e72885dac2b4f4dfe7a. Resources: {'instances', 'ram', 'cores'} {{(pid=120783) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:26:00.780547 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-60acd7f2-67a7-44f8-b375-42417b391bb7 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Going to run 1 instances... {{(pid=120783) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:26:00.783210 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-60acd7f2-67a7-44f8-b375-42417b391bb7 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: a279a105-ed85-45eb-9725-366e0cceb6d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7d45cdd6-750f-40c7-9475-f7bf12fcb204',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120783) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:26:00.830788 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-60acd7f2-67a7-44f8-b375-42417b391bb7 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.646883 Aug 27 02:26:00.837708 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 380/774] 10.222.0.61 () {60 vars in 1147 bytes} [Sat Aug 27 02:26:00 2022] POST /compute/v2.1/servers => generated 402 bytes in 648 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:26:00.838063 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-cdabbe93-583b-4e04-a81b-8a36eb854b06 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fbea2c71674b239e6d8fba6518e962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d9d02db5c49fda33321f2914a7f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:00.843089 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-fe3fcdf5-4996-487d-a6ca-da8062877fa8 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:26:00.843766 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-fe3fcdf5-4996-487d-a6ca-da8062877fa8 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: a279a105-ed85-45eb-9725-366e0cceb6d6] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:26:00.849158 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-cdabbe93-583b-4e04-a81b-8a36eb854b06 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "GET /compute/v2.1/servers/9cad910f-6edf-4462-9db0-4e7f0a060620" status: 200 len: 1363 microversion: 2.1 time: 0.163780 Aug 27 02:26:00.849994 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 395/775] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:26:00 2022] GET /compute/v2.1/servers/9cad910f-6edf-4462-9db0-4e7f0a060620 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:26:00.901233 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-fe3fcdf5-4996-487d-a6ca-da8062877fa8 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6f819365574091ae344f14e47f487f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa1c411b57d4e72885dac2b4f4dfe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:00.910296 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-fe3fcdf5-4996-487d-a6ca-da8062877fa8 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/a279a105-ed85-45eb-9725-366e0cceb6d6" status: 200 len: 1242 microversion: 2.1 time: 0.071190 Aug 27 02:26:00.910879 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 381/776] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:26:00 2022] GET /compute/v2.1/servers/a279a105-ed85-45eb-9725-366e0cceb6d6 => generated 1242 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:26:01.490101 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-20398f22-d0c0-4d48-916b-3e19b1ea06a9 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:26:01.490752 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-20398f22-d0c0-4d48-916b-3e19b1ea06a9 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 1b9390be-aab0-4240-83d9-0f815f094605] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:26:01.497928 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-20398f22-d0c0-4d48-916b-3e19b1ea06a9 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:01.498413 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-20398f22-d0c0-4d48-916b-3e19b1ea06a9 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:01.498870 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-20398f22-d0c0-4d48-916b-3e19b1ea06a9 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:01.499566 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-20398f22-d0c0-4d48-916b-3e19b1ea06a9 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:01.500019 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-20398f22-d0c0-4d48-916b-3e19b1ea06a9 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:01.500447 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-20398f22-d0c0-4d48-916b-3e19b1ea06a9 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:01.638300 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-20398f22-d0c0-4d48-916b-3e19b1ea06a9 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:01.642363 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:26:01.647873 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-20398f22-d0c0-4d48-916b-3e19b1ea06a9 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605" status: 200 len: 1688 microversion: 2.1 time: 0.161835 Aug 27 02:26:01.648460 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 396/777] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:26:01 2022] GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605 => generated 1688 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:26:01.870870 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-e0b0e86d-2544-412a-8987-76f893808a49 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:26:01.871415 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-e0b0e86d-2544-412a-8987-76f893808a49 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 9cad910f-6edf-4462-9db0-4e7f0a060620] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:26:01.879235 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e0b0e86d-2544-412a-8987-76f893808a49 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:01.879795 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e0b0e86d-2544-412a-8987-76f893808a49 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:01.880369 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e0b0e86d-2544-412a-8987-76f893808a49 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:01.881148 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e0b0e86d-2544-412a-8987-76f893808a49 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:01.881699 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e0b0e86d-2544-412a-8987-76f893808a49 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:01.882195 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e0b0e86d-2544-412a-8987-76f893808a49 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:01.930859 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-5f90f6e1-12b6-42d5-8f51-775588aca530 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:26:01.931748 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-5f90f6e1-12b6-42d5-8f51-775588aca530 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: a279a105-ed85-45eb-9725-366e0cceb6d6] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:26:01.939121 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5f90f6e1-12b6-42d5-8f51-775588aca530 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:01.939654 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5f90f6e1-12b6-42d5-8f51-775588aca530 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:01.940506 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5f90f6e1-12b6-42d5-8f51-775588aca530 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:01.941126 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5f90f6e1-12b6-42d5-8f51-775588aca530 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:01.941761 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5f90f6e1-12b6-42d5-8f51-775588aca530 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:01.942333 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5f90f6e1-12b6-42d5-8f51-775588aca530 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:02.005778 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-5f90f6e1-12b6-42d5-8f51-775588aca530 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6f819365574091ae344f14e47f487f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa1c411b57d4e72885dac2b4f4dfe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:02.013654 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-5f90f6e1-12b6-42d5-8f51-775588aca530 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/a279a105-ed85-45eb-9725-366e0cceb6d6" status: 200 len: 1294 microversion: 2.1 time: 0.086693 Aug 27 02:26:02.014233 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 397/778] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:26:01 2022] GET /compute/v2.1/servers/a279a105-ed85-45eb-9725-366e0cceb6d6 => generated 1294 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:26:02.118326 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-e0b0e86d-2544-412a-8987-76f893808a49 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fbea2c71674b239e6d8fba6518e962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d9d02db5c49fda33321f2914a7f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:02.126822 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-e0b0e86d-2544-412a-8987-76f893808a49 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "GET /compute/v2.1/servers/9cad910f-6edf-4462-9db0-4e7f0a060620" status: 200 len: 1363 microversion: 2.1 time: 0.259912 Aug 27 02:26:02.127312 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 382/779] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:26:01 2022] GET /compute/v2.1/servers/9cad910f-6edf-4462-9db0-4e7f0a060620 => generated 1363 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:26:02.669958 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-d3fc7e3b-0b67-4f9b-b48e-4555f15e0795 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:26:02.670650 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-d3fc7e3b-0b67-4f9b-b48e-4555f15e0795 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 1b9390be-aab0-4240-83d9-0f815f094605] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:26:02.678408 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d3fc7e3b-0b67-4f9b-b48e-4555f15e0795 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:02.678898 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d3fc7e3b-0b67-4f9b-b48e-4555f15e0795 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:02.679327 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d3fc7e3b-0b67-4f9b-b48e-4555f15e0795 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:02.680922 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d3fc7e3b-0b67-4f9b-b48e-4555f15e0795 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:02.681382 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d3fc7e3b-0b67-4f9b-b48e-4555f15e0795 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:02.681828 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d3fc7e3b-0b67-4f9b-b48e-4555f15e0795 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:02.757962 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-d3fc7e3b-0b67-4f9b-b48e-4555f15e0795 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:02.790723 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-d3fc7e3b-0b67-4f9b-b48e-4555f15e0795 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605" status: 200 len: 1620 microversion: 2.1 time: 0.124992 Aug 27 02:26:02.791303 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 398/780] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:26:02 2022] GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605 => generated 1620 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:26:03.035877 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-b2937da3-75b1-4b38-825a-78dc9f8eb8bf tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:26:03.036931 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-b2937da3-75b1-4b38-825a-78dc9f8eb8bf tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: a279a105-ed85-45eb-9725-366e0cceb6d6] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:26:03.045585 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b2937da3-75b1-4b38-825a-78dc9f8eb8bf tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:03.046346 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b2937da3-75b1-4b38-825a-78dc9f8eb8bf tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:03.046901 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b2937da3-75b1-4b38-825a-78dc9f8eb8bf tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:03.047711 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b2937da3-75b1-4b38-825a-78dc9f8eb8bf tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:03.048586 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b2937da3-75b1-4b38-825a-78dc9f8eb8bf tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:03.049114 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b2937da3-75b1-4b38-825a-78dc9f8eb8bf tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:03.053452 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [req-8d3ac179-4af7-4dda-bd30-d34c579bf8d7 req-3e52a6eb-62d0-4ed6-bcec-ac315b7eda5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b9390be-aab0-4240-83d9-0f815f094605", "name": "network-vif-deleted", "tag": "2d52c295-4b5b-44d1-aa5d-fbba4fb2a454"}]} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:26:03.063624 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-8d3ac179-4af7-4dda-bd30-d34c579bf8d7 req-3e52a6eb-62d0-4ed6-bcec-ac315b7eda5f service nova] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:03.064092 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-8d3ac179-4af7-4dda-bd30-d34c579bf8d7 req-3e52a6eb-62d0-4ed6-bcec-ac315b7eda5f service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:03.064721 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-8d3ac179-4af7-4dda-bd30-d34c579bf8d7 req-3e52a6eb-62d0-4ed6-bcec-ac315b7eda5f service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:03.077366 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.compute.server_external_events [req-8d3ac179-4af7-4dda-bd30-d34c579bf8d7 req-3e52a6eb-62d0-4ed6-bcec-ac315b7eda5f service nova] Creating event network-vif-deleted:2d52c295-4b5b-44d1-aa5d-fbba4fb2a454 for instance 1b9390be-aab0-4240-83d9-0f815f094605 on hv-cinder-84630 Aug 27 02:26:03.082411 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [req-8d3ac179-4af7-4dda-bd30-d34c579bf8d7 req-3e52a6eb-62d0-4ed6-bcec-ac315b7eda5f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032678 Aug 27 02:26:03.082987 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 399/781] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Aug 27 02:26:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:26:03.120162 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-b2937da3-75b1-4b38-825a-78dc9f8eb8bf tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6f819365574091ae344f14e47f487f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa1c411b57d4e72885dac2b4f4dfe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:03.131898 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-b2937da3-75b1-4b38-825a-78dc9f8eb8bf tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/a279a105-ed85-45eb-9725-366e0cceb6d6" status: 200 len: 1294 microversion: 2.1 time: 0.099951 Aug 27 02:26:03.132662 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 383/782] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:26:03 2022] GET /compute/v2.1/servers/a279a105-ed85-45eb-9725-366e0cceb6d6 => generated 1294 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:26:03.150074 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-94823101-333d-4481-929d-d95c468c7f18 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:26:03.150863 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-94823101-333d-4481-929d-d95c468c7f18 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 9cad910f-6edf-4462-9db0-4e7f0a060620] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:26:03.158538 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-94823101-333d-4481-929d-d95c468c7f18 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:03.159373 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-94823101-333d-4481-929d-d95c468c7f18 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:03.159986 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-94823101-333d-4481-929d-d95c468c7f18 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:03.161068 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-94823101-333d-4481-929d-d95c468c7f18 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:03.161823 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-94823101-333d-4481-929d-d95c468c7f18 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:03.162403 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-94823101-333d-4481-929d-d95c468c7f18 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:03.338672 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-94823101-333d-4481-929d-d95c468c7f18 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fbea2c71674b239e6d8fba6518e962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d9d02db5c49fda33321f2914a7f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:03.347069 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-94823101-333d-4481-929d-d95c468c7f18 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "GET /compute/v2.1/servers/9cad910f-6edf-4462-9db0-4e7f0a060620" status: 200 len: 1363 microversion: 2.1 time: 0.202159 Aug 27 02:26:03.347463 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 400/783] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:26:03 2022] GET /compute/v2.1/servers/9cad910f-6edf-4462-9db0-4e7f0a060620 => generated 1363 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:26:03.813328 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-d8dd76fd-3daa-4a02-a520-e13a17b37378 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:26:03.814335 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-d8dd76fd-3daa-4a02-a520-e13a17b37378 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 1b9390be-aab0-4240-83d9-0f815f094605] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:26:03.821948 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d8dd76fd-3daa-4a02-a520-e13a17b37378 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:03.822884 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d8dd76fd-3daa-4a02-a520-e13a17b37378 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:03.822884 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d8dd76fd-3daa-4a02-a520-e13a17b37378 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:03.823596 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d8dd76fd-3daa-4a02-a520-e13a17b37378 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:03.824627 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d8dd76fd-3daa-4a02-a520-e13a17b37378 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:03.824627 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d8dd76fd-3daa-4a02-a520-e13a17b37378 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:03.905043 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-d8dd76fd-3daa-4a02-a520-e13a17b37378 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:03.913836 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-d8dd76fd-3daa-4a02-a520-e13a17b37378 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605" status: 200 len: 1330 microversion: 2.1 time: 0.105478 Aug 27 02:26:03.914550 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 384/784] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:26:03 2022] GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605 => generated 1330 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:26:04.153762 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-2fd856ad-7735-47d1-b394-2d3a4a5430ef tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:26:04.154374 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-2fd856ad-7735-47d1-b394-2d3a4a5430ef tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: a279a105-ed85-45eb-9725-366e0cceb6d6] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:26:04.161512 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2fd856ad-7735-47d1-b394-2d3a4a5430ef tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:04.162656 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2fd856ad-7735-47d1-b394-2d3a4a5430ef tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:04.162656 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2fd856ad-7735-47d1-b394-2d3a4a5430ef tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:04.163185 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2fd856ad-7735-47d1-b394-2d3a4a5430ef tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:04.163816 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2fd856ad-7735-47d1-b394-2d3a4a5430ef tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:04.164241 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2fd856ad-7735-47d1-b394-2d3a4a5430ef tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:04.232358 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-2fd856ad-7735-47d1-b394-2d3a4a5430ef tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6f819365574091ae344f14e47f487f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa1c411b57d4e72885dac2b4f4dfe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:04.240695 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-2fd856ad-7735-47d1-b394-2d3a4a5430ef tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/a279a105-ed85-45eb-9725-366e0cceb6d6" status: 200 len: 1302 microversion: 2.1 time: 0.091004 Aug 27 02:26:04.254151 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 401/785] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:26:04 2022] GET /compute/v2.1/servers/a279a105-ed85-45eb-9725-366e0cceb6d6 => generated 1302 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:26:04.371891 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-fb92b9a7-e88e-4535-84c8-2f029bb9534a tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:26:04.373152 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-fb92b9a7-e88e-4535-84c8-2f029bb9534a tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 9cad910f-6edf-4462-9db0-4e7f0a060620] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:26:04.379647 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fb92b9a7-e88e-4535-84c8-2f029bb9534a tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:04.380309 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fb92b9a7-e88e-4535-84c8-2f029bb9534a tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:04.381002 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fb92b9a7-e88e-4535-84c8-2f029bb9534a tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:04.381767 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fb92b9a7-e88e-4535-84c8-2f029bb9534a tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:04.382416 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fb92b9a7-e88e-4535-84c8-2f029bb9534a tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:04.383302 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fb92b9a7-e88e-4535-84c8-2f029bb9534a tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:04.524422 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-fb92b9a7-e88e-4535-84c8-2f029bb9534a tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fbea2c71674b239e6d8fba6518e962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d9d02db5c49fda33321f2914a7f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:04.532362 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-fb92b9a7-e88e-4535-84c8-2f029bb9534a tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "GET /compute/v2.1/servers/9cad910f-6edf-4462-9db0-4e7f0a060620" status: 200 len: 1548 microversion: 2.1 time: 0.165929 Aug 27 02:26:04.532913 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 385/786] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:26:04 2022] GET /compute/v2.1/servers/9cad910f-6edf-4462-9db0-4e7f0a060620 => generated 1548 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:26:04.555895 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-bc2d6adb-55a4-4a95-8ce8-9012cfebc927 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:26:04.556433 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-bc2d6adb-55a4-4a95-8ce8-9012cfebc927 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 9cad910f-6edf-4462-9db0-4e7f0a060620] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:26:04.564718 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-bc2d6adb-55a4-4a95-8ce8-9012cfebc927 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:04.565330 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-bc2d6adb-55a4-4a95-8ce8-9012cfebc927 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:04.565879 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-bc2d6adb-55a4-4a95-8ce8-9012cfebc927 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:04.566693 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-bc2d6adb-55a4-4a95-8ce8-9012cfebc927 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:04.567401 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-bc2d6adb-55a4-4a95-8ce8-9012cfebc927 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:04.567973 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-bc2d6adb-55a4-4a95-8ce8-9012cfebc927 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:04.651907 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-bc2d6adb-55a4-4a95-8ce8-9012cfebc927 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "GET /compute/v2.1/servers/9cad910f-6edf-4462-9db0-4e7f0a060620/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.102314 Aug 27 02:26:04.652529 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 402/787] 10.222.0.61 () {58 vars in 1275 bytes} [Sat Aug 27 02:26:04 2022] GET /compute/v2.1/servers/9cad910f-6edf-4462-9db0-4e7f0a060620/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:26:04.935198 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-84df4fe1-a548-43c2-9e01-622b3819ac74 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:26:04.935730 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-84df4fe1-a548-43c2-9e01-622b3819ac74 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 1b9390be-aab0-4240-83d9-0f815f094605] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:26:04.942033 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-84df4fe1-a548-43c2-9e01-622b3819ac74 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:04.942691 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-84df4fe1-a548-43c2-9e01-622b3819ac74 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:04.943133 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-84df4fe1-a548-43c2-9e01-622b3819ac74 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:04.944580 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-84df4fe1-a548-43c2-9e01-622b3819ac74 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:04.945039 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-84df4fe1-a548-43c2-9e01-622b3819ac74 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:04.945674 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-84df4fe1-a548-43c2-9e01-622b3819ac74 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:04.991942 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-84df4fe1-a548-43c2-9e01-622b3819ac74 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:04.992428 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-84df4fe1-a548-43c2-9e01-622b3819ac74 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:04.992856 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-84df4fe1-a548-43c2-9e01-622b3819ac74 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:04.993307 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.objects.instance [None req-84df4fe1-a548-43c2-9e01-622b3819ac74 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lazy-loading 'fault' on Instance uuid 1b9390be-aab0-4240-83d9-0f815f094605 {{(pid=120783) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:26:05.058545 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-84df4fe1-a548-43c2-9e01-622b3819ac74 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:05.069244 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-84df4fe1-a548-43c2-9e01-622b3819ac74 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605" status: 200 len: 1335 microversion: 2.1 time: 0.138104 Aug 27 02:26:05.070120 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 386/788] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:26:04 2022] GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605 => generated 1335 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:26:05.264181 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-6e10176e-3210-43aa-91b2-eef7db8eeacb tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:26:05.265103 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-6e10176e-3210-43aa-91b2-eef7db8eeacb tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: a279a105-ed85-45eb-9725-366e0cceb6d6] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:26:05.271390 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6e10176e-3210-43aa-91b2-eef7db8eeacb tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:05.271872 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6e10176e-3210-43aa-91b2-eef7db8eeacb tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:05.272300 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6e10176e-3210-43aa-91b2-eef7db8eeacb tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:05.272986 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6e10176e-3210-43aa-91b2-eef7db8eeacb tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:05.273459 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6e10176e-3210-43aa-91b2-eef7db8eeacb tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:05.273880 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6e10176e-3210-43aa-91b2-eef7db8eeacb tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:05.342457 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-6e10176e-3210-43aa-91b2-eef7db8eeacb tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6f819365574091ae344f14e47f487f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa1c411b57d4e72885dac2b4f4dfe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:05.350584 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-6e10176e-3210-43aa-91b2-eef7db8eeacb tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/a279a105-ed85-45eb-9725-366e0cceb6d6" status: 200 len: 1300 microversion: 2.1 time: 0.090872 Aug 27 02:26:05.351186 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 403/789] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:26:05 2022] GET /compute/v2.1/servers/a279a105-ed85-45eb-9725-366e0cceb6d6 => generated 1300 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:26:06.091036 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-7933d26f-859d-4902-ac1f-9178594e375b tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:26:06.091943 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-7933d26f-859d-4902-ac1f-9178594e375b tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 1b9390be-aab0-4240-83d9-0f815f094605] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:26:06.098598 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7933d26f-859d-4902-ac1f-9178594e375b tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:06.099097 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7933d26f-859d-4902-ac1f-9178594e375b tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:06.099538 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7933d26f-859d-4902-ac1f-9178594e375b tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:06.100260 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7933d26f-859d-4902-ac1f-9178594e375b tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:06.100717 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7933d26f-859d-4902-ac1f-9178594e375b tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:06.101134 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7933d26f-859d-4902-ac1f-9178594e375b tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:06.115858 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.wsgi [None req-7933d26f-859d-4902-ac1f-9178594e375b tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] HTTP exception thrown: Instance 1b9390be-aab0-4240-83d9-0f815f094605 could not be found. Aug 27 02:26:06.117683 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-7933d26f-859d-4902-ac1f-9178594e375b tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Request method failure captured: Aug 27 02:26:06.117683 dv-cinder-846303-3-smb devstack@n-api.service[120783]: request: GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605 HTTP/1.1 Aug 27 02:26:06.117683 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Accept: application/json Aug 27 02:26:06.117683 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Accept-Encoding: identity Aug 27 02:26:06.117683 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Connection: close Aug 27 02:26:06.117683 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Content-Length: 0 Aug 27 02:26:06.117683 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Content-Type: application/json Aug 27 02:26:06.117683 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Host: 10.222.0.61 Aug 27 02:26:06.117683 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Openstack-System-Scope: None Aug 27 02:26:06.117683 dv-cinder-846303-3-smb devstack@n-api.service[120783]: User-Agent: python-urllib3/1.26.11 Aug 27 02:26:06.117683 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Auth-Token: gAAAAABjCX-CxsQboupe7LGVgMB3IvNk6DZKE8jyi_9nbzm-Wvf3iOAH1nHoxh235cCKiWLsOX-TSw1YO5xdAHVdx_5iwsz77LAdzGTVwjuAfG2PP9Jsj1PrgoZ4Q6XQRHgC6UAoTOMizINS2RlKs2CbHJ_FMN6pGKDTXTr1l-0RRb1mYFgkHEU Aug 27 02:26:06.117683 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Domain-Id: None Aug 27 02:26:06.117683 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Domain-Name: None Aug 27 02:26:06.117683 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Identity-Status: Confirmed Aug 27 02:26:06.117683 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Is-Admin-Project: True Aug 27 02:26:06.117683 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Project-Domain-Id: default Aug 27 02:26:06.117683 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Project-Domain-Name: Default Aug 27 02:26:06.117683 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Project-Id: 67209b74f2fa4ae7ad9762d141378a5d Aug 27 02:26:06.117683 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1743925357 Aug 27 02:26:06.117683 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Role: member,reader Aug 27 02:26:06.117683 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Roles: member,reader Aug 27 02:26:06.119472 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/67209b74f2fa4ae7ad9762d141378a5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_67209b74f2fa4ae7ad9762d141378a5d", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/67209b74f2fa4ae7ad9762d141378a5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/67209b74f2fa4ae7ad9762d141378a5d"}]}] Aug 27 02:26:06.119472 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1743925357 Aug 27 02:26:06.119472 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Tenant-Id: 67209b74f2fa4ae7ad9762d141378a5d Aug 27 02:26:06.119472 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1743925357 Aug 27 02:26:06.119472 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User: tempest-ServerRescueNegativeTestJSON-1743925357-project Aug 27 02:26:06.119472 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User-Domain-Id: default Aug 27 02:26:06.119472 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User-Domain-Name: Default Aug 27 02:26:06.119472 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User-Id: 1eb664209056410d890d1b2b8bfa0155 Aug 27 02:26:06.119472 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1743925357-project Aug 27 02:26:06.119472 dv-cinder-846303-3-smb devstack@n-api.service[120783]: method: > Aug 27 02:26:06.119472 dv-cinder-846303-3-smb devstack@n-api.service[120783]: exception: Instance 1b9390be-aab0-4240-83d9-0f815f094605 could not be found. Aug 27 02:26:06.119472 dv-cinder-846303-3-smb devstack@n-api.service[120783]: action_args: {'id': '1b9390be-aab0-4240-83d9-0f815f094605'} Aug 27 02:26:06.120383 dv-cinder-846303-3-smb devstack@n-api.service[120783]: {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:26:06.120383 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:26:06.120383 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:26:06.120383 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:26:06.120383 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:26:06.120383 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:26:06.120383 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:26:06.120383 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:26:06.120383 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:26:06.120383 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:26:06.120383 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b9390be-aab0-4240-83d9-0f815f094605 could not be found. Aug 27 02:26:06.120383 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:26:06.120383 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:26:06.120383 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:26:06.120383 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:26:06.120383 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:26:06.120383 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:26:06.120383 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:26:06.120383 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:26:06.120383 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:26:06.121850 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:26:06.121850 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:26:06.121850 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:26:06.121850 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:26:06.121850 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:26:06.121850 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:26:06.121850 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:26:06.121850 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b9390be-aab0-4240-83d9-0f815f094605 could not be found. Aug 27 02:26:06.121850 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:26:06.121850 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:26:06.121850 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:26:06.121850 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:26:06.121850 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:26:06.121850 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:26:06.121850 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:26:06.121850 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:26:06.121850 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b9390be-aab0-4240-83d9-0f815f094605 could not be found. Aug 27 02:26:06.121850 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:26:06.123211 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-7933d26f-859d-4902-ac1f-9178594e375b tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Returning 404 to user: Instance 1b9390be-aab0-4240-83d9-0f815f094605 could not be found. {{(pid=120783) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:26:06.123211 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-7933d26f-859d-4902-ac1f-9178594e375b tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605" status: 404 len: 111 microversion: 2.1 time: 0.032175 Aug 27 02:26:06.123211 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 387/790] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:26:06 2022] GET /compute/v2.1/servers/1b9390be-aab0-4240-83d9-0f815f094605 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:26:06.128635 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-9abcaab9-724a-47de-b168-4b30ab5dcfc2 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '.version_select at 0x7fd80846fca0>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:26:06.154473 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-9abcaab9-724a-47de-b168-4b30ab5dcfc2 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1982819205" status: 202 len: 0 microversion: 2.1 time: 0.029586 Aug 27 02:26:06.155226 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 404/791] 10.222.0.61 () {58 vars in 1221 bytes} [Sat Aug 27 02:26:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1982819205 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:26:06.272710 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [req-ff3d1fd3-57cd-4bbd-8087-7928f6dba075 req-598c9ac3-69f6-4a65-9a13-d4c19f837a32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9cad910f-6edf-4462-9db0-4e7f0a060620", "tag": "431c87b1-a7a6-494e-bce0-cc55b95d52f7"}]} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:26:06.284291 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-ff3d1fd3-57cd-4bbd-8087-7928f6dba075 req-598c9ac3-69f6-4a65-9a13-d4c19f837a32 service nova] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:06.284998 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-ff3d1fd3-57cd-4bbd-8087-7928f6dba075 req-598c9ac3-69f6-4a65-9a13-d4c19f837a32 service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:06.285849 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-ff3d1fd3-57cd-4bbd-8087-7928f6dba075 req-598c9ac3-69f6-4a65-9a13-d4c19f837a32 service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:06.300317 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.compute.server_external_events [req-ff3d1fd3-57cd-4bbd-8087-7928f6dba075 req-598c9ac3-69f6-4a65-9a13-d4c19f837a32 service nova] Creating event network-changed:431c87b1-a7a6-494e-bce0-cc55b95d52f7 for instance 9cad910f-6edf-4462-9db0-4e7f0a060620 on hv-cinder-84630 Aug 27 02:26:06.307074 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [req-ff3d1fd3-57cd-4bbd-8087-7928f6dba075 req-598c9ac3-69f6-4a65-9a13-d4c19f837a32 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038739 Aug 27 02:26:06.308329 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 388/792] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Aug 27 02:26:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:26:06.380934 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-3744e4a5-43be-457a-8be4-942592c5dfbd tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:26:06.381676 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-3744e4a5-43be-457a-8be4-942592c5dfbd tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: a279a105-ed85-45eb-9725-366e0cceb6d6] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:26:06.395054 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3744e4a5-43be-457a-8be4-942592c5dfbd tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:06.395054 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3744e4a5-43be-457a-8be4-942592c5dfbd tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:06.395054 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3744e4a5-43be-457a-8be4-942592c5dfbd tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:06.395431 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3744e4a5-43be-457a-8be4-942592c5dfbd tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:06.396310 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3744e4a5-43be-457a-8be4-942592c5dfbd tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:06.397065 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3744e4a5-43be-457a-8be4-942592c5dfbd tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:06.696835 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-3744e4a5-43be-457a-8be4-942592c5dfbd tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6f819365574091ae344f14e47f487f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa1c411b57d4e72885dac2b4f4dfe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:06.722098 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-3744e4a5-43be-457a-8be4-942592c5dfbd tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/a279a105-ed85-45eb-9725-366e0cceb6d6" status: 200 len: 1368 microversion: 2.1 time: 0.344942 Aug 27 02:26:06.722763 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 405/793] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:26:06 2022] GET /compute/v2.1/servers/a279a105-ed85-45eb-9725-366e0cceb6d6 => generated 1368 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:26:07.744307 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-8fe28ddb-0f44-466e-9ce9-09ff60e80287 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:26:07.744984 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-8fe28ddb-0f44-466e-9ce9-09ff60e80287 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: a279a105-ed85-45eb-9725-366e0cceb6d6] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:26:07.751290 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8fe28ddb-0f44-466e-9ce9-09ff60e80287 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:07.751776 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8fe28ddb-0f44-466e-9ce9-09ff60e80287 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:07.752206 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8fe28ddb-0f44-466e-9ce9-09ff60e80287 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:07.752897 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8fe28ddb-0f44-466e-9ce9-09ff60e80287 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:07.753347 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8fe28ddb-0f44-466e-9ce9-09ff60e80287 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:07.753790 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8fe28ddb-0f44-466e-9ce9-09ff60e80287 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:07.884641 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-8fe28ddb-0f44-466e-9ce9-09ff60e80287 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6f819365574091ae344f14e47f487f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa1c411b57d4e72885dac2b4f4dfe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:07.893482 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-8fe28ddb-0f44-466e-9ce9-09ff60e80287 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/a279a105-ed85-45eb-9725-366e0cceb6d6" status: 200 len: 1368 microversion: 2.1 time: 0.154031 Aug 27 02:26:07.894136 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 389/794] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:26:07 2022] GET /compute/v2.1/servers/a279a105-ed85-45eb-9725-366e0cceb6d6 => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:26:08.328551 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [req-680d544b-3a27-4cea-bd2e-80cca8e06afe req-7673bcd8-2ac6-4e2d-ba9f-1e5b5f8ce294 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a279a105-ed85-45eb-9725-366e0cceb6d6", "tag": "3eec6bbd-2647-430f-80b4-d136f3c0de5a"}]} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:26:08.338851 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-680d544b-3a27-4cea-bd2e-80cca8e06afe req-7673bcd8-2ac6-4e2d-ba9f-1e5b5f8ce294 service nova] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:08.339329 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-680d544b-3a27-4cea-bd2e-80cca8e06afe req-7673bcd8-2ac6-4e2d-ba9f-1e5b5f8ce294 service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:08.339746 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-680d544b-3a27-4cea-bd2e-80cca8e06afe req-7673bcd8-2ac6-4e2d-ba9f-1e5b5f8ce294 service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:08.351494 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.compute.server_external_events [req-680d544b-3a27-4cea-bd2e-80cca8e06afe req-7673bcd8-2ac6-4e2d-ba9f-1e5b5f8ce294 service nova] Creating event network-changed:3eec6bbd-2647-430f-80b4-d136f3c0de5a for instance a279a105-ed85-45eb-9725-366e0cceb6d6 on hv-cinder-84630 Aug 27 02:26:08.356888 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [req-680d544b-3a27-4cea-bd2e-80cca8e06afe req-7673bcd8-2ac6-4e2d-ba9f-1e5b5f8ce294 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032318 Aug 27 02:26:08.357511 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 406/795] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Aug 27 02:26:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:26:08.914382 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-0161acee-0371-469a-9127-6eb8a758340b tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:26:08.915111 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-0161acee-0371-469a-9127-6eb8a758340b tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: a279a105-ed85-45eb-9725-366e0cceb6d6] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:26:08.923507 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0161acee-0371-469a-9127-6eb8a758340b tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:08.924141 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0161acee-0371-469a-9127-6eb8a758340b tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:08.924731 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0161acee-0371-469a-9127-6eb8a758340b tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:08.925489 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0161acee-0371-469a-9127-6eb8a758340b tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:08.925947 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0161acee-0371-469a-9127-6eb8a758340b tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:08.926364 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0161acee-0371-469a-9127-6eb8a758340b tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:09.148197 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-0161acee-0371-469a-9127-6eb8a758340b tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6f819365574091ae344f14e47f487f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa1c411b57d4e72885dac2b4f4dfe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:09.158496 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-0161acee-0371-469a-9127-6eb8a758340b tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/a279a105-ed85-45eb-9725-366e0cceb6d6" status: 200 len: 1368 microversion: 2.1 time: 0.248073 Aug 27 02:26:09.159232 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 390/796] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:26:08 2022] GET /compute/v2.1/servers/a279a105-ed85-45eb-9725-366e0cceb6d6 => generated 1368 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:26:09.322936 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-7ff7fd37-652c-44e1-ade7-3ae1b11ecdb0 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:26:09.324253 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-7ff7fd37-652c-44e1-ade7-3ae1b11ecdb0 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 5cbe7ad9-5124-4014-9d2a-e877493b2a9e] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:26:09.331360 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7ff7fd37-652c-44e1-ade7-3ae1b11ecdb0 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:09.332143 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7ff7fd37-652c-44e1-ade7-3ae1b11ecdb0 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:09.332498 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7ff7fd37-652c-44e1-ade7-3ae1b11ecdb0 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:09.333304 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7ff7fd37-652c-44e1-ade7-3ae1b11ecdb0 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:09.334030 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7ff7fd37-652c-44e1-ade7-3ae1b11ecdb0 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:09.334481 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7ff7fd37-652c-44e1-ade7-3ae1b11ecdb0 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:09.363513 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-7ff7fd37-652c-44e1-ade7-3ae1b11ecdb0 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 5cbe7ad9-5124-4014-9d2a-e877493b2a9e] Going to try to terminate instance {{(pid=120782) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:26:09.450951 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-7ff7fd37-652c-44e1-ade7-3ae1b11ecdb0 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "DELETE /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e" status: 204 len: 0 microversion: 2.1 time: 0.132214 Aug 27 02:26:09.454781 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 407/797] 10.222.0.61 () {58 vars in 1239 bytes} [Sat Aug 27 02:26:09 2022] DELETE /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:26:09.460409 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-d52f9208-ac59-4f61-bf67-b1c409aa17fd tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:26:09.461064 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-d52f9208-ac59-4f61-bf67-b1c409aa17fd tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 5cbe7ad9-5124-4014-9d2a-e877493b2a9e] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:26:09.469491 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d52f9208-ac59-4f61-bf67-b1c409aa17fd tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:09.469994 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d52f9208-ac59-4f61-bf67-b1c409aa17fd tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:09.470432 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d52f9208-ac59-4f61-bf67-b1c409aa17fd tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:09.471589 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d52f9208-ac59-4f61-bf67-b1c409aa17fd tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:09.471589 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d52f9208-ac59-4f61-bf67-b1c409aa17fd tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:09.472007 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d52f9208-ac59-4f61-bf67-b1c409aa17fd tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:09.615530 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-d52f9208-ac59-4f61-bf67-b1c409aa17fd tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:09.623928 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-d52f9208-ac59-4f61-bf67-b1c409aa17fd tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e" status: 200 len: 1508 microversion: 2.1 time: 0.167939 Aug 27 02:26:09.624533 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 391/798] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:26:09 2022] GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e => generated 1508 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:26:10.183130 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-9058cf35-64fa-4aef-a7a5-23cf1aa4de50 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:26:10.183825 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-9058cf35-64fa-4aef-a7a5-23cf1aa4de50 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: a279a105-ed85-45eb-9725-366e0cceb6d6] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:26:10.190258 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9058cf35-64fa-4aef-a7a5-23cf1aa4de50 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:10.190781 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9058cf35-64fa-4aef-a7a5-23cf1aa4de50 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:10.191192 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9058cf35-64fa-4aef-a7a5-23cf1aa4de50 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:10.191886 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9058cf35-64fa-4aef-a7a5-23cf1aa4de50 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:10.192374 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9058cf35-64fa-4aef-a7a5-23cf1aa4de50 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:10.192829 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9058cf35-64fa-4aef-a7a5-23cf1aa4de50 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:10.328138 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-9058cf35-64fa-4aef-a7a5-23cf1aa4de50 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6f819365574091ae344f14e47f487f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa1c411b57d4e72885dac2b4f4dfe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:10.336228 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-9058cf35-64fa-4aef-a7a5-23cf1aa4de50 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/a279a105-ed85-45eb-9725-366e0cceb6d6" status: 200 len: 1368 microversion: 2.1 time: 0.157405 Aug 27 02:26:10.337041 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 408/799] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:26:10 2022] GET /compute/v2.1/servers/a279a105-ed85-45eb-9725-366e0cceb6d6 => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:26:10.645803 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-93137cdf-bcf4-4683-8c7a-552c3cc30bc8 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:26:10.646402 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-93137cdf-bcf4-4683-8c7a-552c3cc30bc8 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 5cbe7ad9-5124-4014-9d2a-e877493b2a9e] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:26:10.653238 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-93137cdf-bcf4-4683-8c7a-552c3cc30bc8 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:10.653832 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-93137cdf-bcf4-4683-8c7a-552c3cc30bc8 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:10.654684 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-93137cdf-bcf4-4683-8c7a-552c3cc30bc8 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:10.655576 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-93137cdf-bcf4-4683-8c7a-552c3cc30bc8 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:10.656039 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-93137cdf-bcf4-4683-8c7a-552c3cc30bc8 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:10.656454 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-93137cdf-bcf4-4683-8c7a-552c3cc30bc8 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:10.751849 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell0:SELECT=2 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:26:10.791939 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-93137cdf-bcf4-4683-8c7a-552c3cc30bc8 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:10.799721 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-93137cdf-bcf4-4683-8c7a-552c3cc30bc8 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e" status: 200 len: 1508 microversion: 2.1 time: 0.158213 Aug 27 02:26:10.800284 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 392/800] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:26:10 2022] GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e => generated 1508 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:26:11.164589 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [req-14f4e71a-4105-4b07-aa30-cdbbd664dcd3 req-fa458cdc-06fa-4f0b-a4eb-b254ce4f5438 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a279a105-ed85-45eb-9725-366e0cceb6d6", "name": "network-vif-plugged", "status": "completed", "tag": "3eec6bbd-2647-430f-80b4-d136f3c0de5a"}]} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:26:11.174648 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-14f4e71a-4105-4b07-aa30-cdbbd664dcd3 req-fa458cdc-06fa-4f0b-a4eb-b254ce4f5438 service nova] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:11.175122 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-14f4e71a-4105-4b07-aa30-cdbbd664dcd3 req-fa458cdc-06fa-4f0b-a4eb-b254ce4f5438 service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:11.175525 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-14f4e71a-4105-4b07-aa30-cdbbd664dcd3 req-fa458cdc-06fa-4f0b-a4eb-b254ce4f5438 service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:11.187125 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.compute.server_external_events [req-14f4e71a-4105-4b07-aa30-cdbbd664dcd3 req-fa458cdc-06fa-4f0b-a4eb-b254ce4f5438 service nova] Creating event network-vif-plugged:3eec6bbd-2647-430f-80b4-d136f3c0de5a for instance a279a105-ed85-45eb-9725-366e0cceb6d6 on hv-cinder-84630 Aug 27 02:26:11.192034 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [req-14f4e71a-4105-4b07-aa30-cdbbd664dcd3 req-fa458cdc-06fa-4f0b-a4eb-b254ce4f5438 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031183 Aug 27 02:26:11.193140 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 409/801] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Aug 27 02:26:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:26:11.356987 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-92aeb40f-afd1-4dec-b2f1-e5c658c50017 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:26:11.357626 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-92aeb40f-afd1-4dec-b2f1-e5c658c50017 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: a279a105-ed85-45eb-9725-366e0cceb6d6] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:26:11.359486 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell0:SELECT=24 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:26:11.365072 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-92aeb40f-afd1-4dec-b2f1-e5c658c50017 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:11.365583 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-92aeb40f-afd1-4dec-b2f1-e5c658c50017 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:11.366023 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-92aeb40f-afd1-4dec-b2f1-e5c658c50017 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:11.366714 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-92aeb40f-afd1-4dec-b2f1-e5c658c50017 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:11.367168 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-92aeb40f-afd1-4dec-b2f1-e5c658c50017 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:11.367617 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-92aeb40f-afd1-4dec-b2f1-e5c658c50017 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:11.500609 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-92aeb40f-afd1-4dec-b2f1-e5c658c50017 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6f819365574091ae344f14e47f487f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa1c411b57d4e72885dac2b4f4dfe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:11.508447 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-92aeb40f-afd1-4dec-b2f1-e5c658c50017 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/a279a105-ed85-45eb-9725-366e0cceb6d6" status: 200 len: 1368 microversion: 2.1 time: 0.155409 Aug 27 02:26:11.509015 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 393/802] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:26:11 2022] GET /compute/v2.1/servers/a279a105-ed85-45eb-9725-366e0cceb6d6 => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:26:11.821677 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-be587b82-f075-4364-a9de-e9ced914dd37 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:26:11.822373 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-be587b82-f075-4364-a9de-e9ced914dd37 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 5cbe7ad9-5124-4014-9d2a-e877493b2a9e] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:26:11.829367 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-be587b82-f075-4364-a9de-e9ced914dd37 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:11.829905 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-be587b82-f075-4364-a9de-e9ced914dd37 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:11.830341 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-be587b82-f075-4364-a9de-e9ced914dd37 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:11.831166 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-be587b82-f075-4364-a9de-e9ced914dd37 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:11.831650 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-be587b82-f075-4364-a9de-e9ced914dd37 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:11.832114 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-be587b82-f075-4364-a9de-e9ced914dd37 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:11.972401 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-be587b82-f075-4364-a9de-e9ced914dd37 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:11.981106 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-be587b82-f075-4364-a9de-e9ced914dd37 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e" status: 200 len: 1508 microversion: 2.1 time: 0.163873 Aug 27 02:26:11.981777 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 410/803] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:26:11 2022] GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e => generated 1508 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:26:12.529436 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-03d0eed8-8eee-41a1-a6ae-eec1fbee658d tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:26:12.530049 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-03d0eed8-8eee-41a1-a6ae-eec1fbee658d tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: a279a105-ed85-45eb-9725-366e0cceb6d6] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:26:12.536909 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-03d0eed8-8eee-41a1-a6ae-eec1fbee658d tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:12.537598 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-03d0eed8-8eee-41a1-a6ae-eec1fbee658d tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:12.538098 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-03d0eed8-8eee-41a1-a6ae-eec1fbee658d tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:12.538991 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-03d0eed8-8eee-41a1-a6ae-eec1fbee658d tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:12.539451 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-03d0eed8-8eee-41a1-a6ae-eec1fbee658d tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:12.539993 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-03d0eed8-8eee-41a1-a6ae-eec1fbee658d tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:12.815994 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-03d0eed8-8eee-41a1-a6ae-eec1fbee658d tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6f819365574091ae344f14e47f487f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa1c411b57d4e72885dac2b4f4dfe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:12.825089 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-03d0eed8-8eee-41a1-a6ae-eec1fbee658d tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/a279a105-ed85-45eb-9725-366e0cceb6d6" status: 200 len: 1368 microversion: 2.1 time: 0.299786 Aug 27 02:26:12.825728 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 394/804] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:26:12 2022] GET /compute/v2.1/servers/a279a105-ed85-45eb-9725-366e0cceb6d6 => generated 1368 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:26:13.002313 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-704266cb-f24c-47f8-b3b3-c790dddebe0b tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:26:13.002972 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-704266cb-f24c-47f8-b3b3-c790dddebe0b tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 5cbe7ad9-5124-4014-9d2a-e877493b2a9e] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:26:13.010454 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-704266cb-f24c-47f8-b3b3-c790dddebe0b tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:13.011116 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-704266cb-f24c-47f8-b3b3-c790dddebe0b tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:13.011639 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-704266cb-f24c-47f8-b3b3-c790dddebe0b tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:13.012693 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-704266cb-f24c-47f8-b3b3-c790dddebe0b tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:13.013384 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-704266cb-f24c-47f8-b3b3-c790dddebe0b tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:13.014044 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-704266cb-f24c-47f8-b3b3-c790dddebe0b tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:13.087895 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-704266cb-f24c-47f8-b3b3-c790dddebe0b tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:13.097751 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-704266cb-f24c-47f8-b3b3-c790dddebe0b tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e" status: 200 len: 1466 microversion: 2.1 time: 0.099135 Aug 27 02:26:13.113798 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 411/805] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:26:12 2022] GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e => generated 1466 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:26:13.159265 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [req-8d839383-0d03-481f-8baf-c1cd00605973 req-15f7d46c-ebdd-45cc-b639-b1cc576287a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cbe7ad9-5124-4014-9d2a-e877493b2a9e", "name": "network-vif-deleted", "tag": "b531113e-208a-4fe6-85c9-2bb5f663f84a"}]} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:26:13.168723 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-8d839383-0d03-481f-8baf-c1cd00605973 req-15f7d46c-ebdd-45cc-b639-b1cc576287a9 service nova] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:13.169117 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-8d839383-0d03-481f-8baf-c1cd00605973 req-15f7d46c-ebdd-45cc-b639-b1cc576287a9 service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:13.169571 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-8d839383-0d03-481f-8baf-c1cd00605973 req-15f7d46c-ebdd-45cc-b639-b1cc576287a9 service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:13.182050 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.compute.server_external_events [req-8d839383-0d03-481f-8baf-c1cd00605973 req-15f7d46c-ebdd-45cc-b639-b1cc576287a9 service nova] Creating event network-vif-deleted:b531113e-208a-4fe6-85c9-2bb5f663f84a for instance 5cbe7ad9-5124-4014-9d2a-e877493b2a9e on hv-cinder-84630 Aug 27 02:26:13.187596 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [req-8d839383-0d03-481f-8baf-c1cd00605973 req-15f7d46c-ebdd-45cc-b639-b1cc576287a9 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031583 Aug 27 02:26:13.188367 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 395/806] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Aug 27 02:26:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:26:13.846987 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-ffbbfdc7-b6b4-473b-9f3c-42d9a18aa0b0 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:26:13.847708 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-ffbbfdc7-b6b4-473b-9f3c-42d9a18aa0b0 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: a279a105-ed85-45eb-9725-366e0cceb6d6] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:26:13.854419 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ffbbfdc7-b6b4-473b-9f3c-42d9a18aa0b0 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:13.855009 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ffbbfdc7-b6b4-473b-9f3c-42d9a18aa0b0 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:13.855518 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ffbbfdc7-b6b4-473b-9f3c-42d9a18aa0b0 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:13.856308 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ffbbfdc7-b6b4-473b-9f3c-42d9a18aa0b0 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:13.856832 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ffbbfdc7-b6b4-473b-9f3c-42d9a18aa0b0 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:13.857381 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ffbbfdc7-b6b4-473b-9f3c-42d9a18aa0b0 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:13.996948 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-ffbbfdc7-b6b4-473b-9f3c-42d9a18aa0b0 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6f819365574091ae344f14e47f487f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa1c411b57d4e72885dac2b4f4dfe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:14.004623 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-ffbbfdc7-b6b4-473b-9f3c-42d9a18aa0b0 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/a279a105-ed85-45eb-9725-366e0cceb6d6" status: 200 len: 1368 microversion: 2.1 time: 0.161558 Aug 27 02:26:14.005675 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 412/807] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:26:13 2022] GET /compute/v2.1/servers/a279a105-ed85-45eb-9725-366e0cceb6d6 => generated 1368 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:26:14.122005 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-77741882-bb66-4ce7-b97a-8ad53ea0feb3 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:26:14.122707 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-77741882-bb66-4ce7-b97a-8ad53ea0feb3 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 5cbe7ad9-5124-4014-9d2a-e877493b2a9e] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:26:14.130092 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-77741882-bb66-4ce7-b97a-8ad53ea0feb3 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:14.130574 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-77741882-bb66-4ce7-b97a-8ad53ea0feb3 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:14.131001 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-77741882-bb66-4ce7-b97a-8ad53ea0feb3 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:14.131687 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-77741882-bb66-4ce7-b97a-8ad53ea0feb3 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:14.132169 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-77741882-bb66-4ce7-b97a-8ad53ea0feb3 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:14.132589 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-77741882-bb66-4ce7-b97a-8ad53ea0feb3 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:14.165352 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-77741882-bb66-4ce7-b97a-8ad53ea0feb3 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:14.165856 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-77741882-bb66-4ce7-b97a-8ad53ea0feb3 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:14.166279 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-77741882-bb66-4ce7-b97a-8ad53ea0feb3 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:14.166714 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.objects.instance [None req-77741882-bb66-4ce7-b97a-8ad53ea0feb3 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lazy-loading 'fault' on Instance uuid 5cbe7ad9-5124-4014-9d2a-e877493b2a9e {{(pid=120783) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:26:14.208842 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-77741882-bb66-4ce7-b97a-8ad53ea0feb3 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:14.216933 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-77741882-bb66-4ce7-b97a-8ad53ea0feb3 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e" status: 200 len: 1312 microversion: 2.1 time: 0.099297 Aug 27 02:26:14.217526 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 396/808] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:26:14 2022] GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e => generated 1312 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:26:15.033353 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-8b5014e7-d991-4fe2-a8bc-9b0177c69300 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:26:15.033938 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-8b5014e7-d991-4fe2-a8bc-9b0177c69300 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: a279a105-ed85-45eb-9725-366e0cceb6d6] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:26:15.041069 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8b5014e7-d991-4fe2-a8bc-9b0177c69300 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:15.041588 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8b5014e7-d991-4fe2-a8bc-9b0177c69300 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:15.042019 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8b5014e7-d991-4fe2-a8bc-9b0177c69300 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:15.042716 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8b5014e7-d991-4fe2-a8bc-9b0177c69300 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:15.043163 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8b5014e7-d991-4fe2-a8bc-9b0177c69300 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:15.043582 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8b5014e7-d991-4fe2-a8bc-9b0177c69300 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:15.180539 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-8b5014e7-d991-4fe2-a8bc-9b0177c69300 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6f819365574091ae344f14e47f487f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa1c411b57d4e72885dac2b4f4dfe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:15.189325 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-8b5014e7-d991-4fe2-a8bc-9b0177c69300 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/a279a105-ed85-45eb-9725-366e0cceb6d6" status: 200 len: 1558 microversion: 2.1 time: 0.159905 Aug 27 02:26:15.189947 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 413/809] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:26:15 2022] GET /compute/v2.1/servers/a279a105-ed85-45eb-9725-366e0cceb6d6 => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:26:15.214721 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-54653c86-8ec7-4c3e-92ea-22e6fa548c8b tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:26:15.215302 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-54653c86-8ec7-4c3e-92ea-22e6fa548c8b tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: a279a105-ed85-45eb-9725-366e0cceb6d6] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:26:15.217778 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:26:15.223645 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-54653c86-8ec7-4c3e-92ea-22e6fa548c8b tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:15.224128 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-54653c86-8ec7-4c3e-92ea-22e6fa548c8b tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:15.224629 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-54653c86-8ec7-4c3e-92ea-22e6fa548c8b tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:15.225466 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-54653c86-8ec7-4c3e-92ea-22e6fa548c8b tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:15.226024 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-54653c86-8ec7-4c3e-92ea-22e6fa548c8b tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:15.226440 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-54653c86-8ec7-4c3e-92ea-22e6fa548c8b tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:15.238393 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-6f3c7c45-2193-4a76-a873-9eec035a8594 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:26:15.239177 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-6f3c7c45-2193-4a76-a873-9eec035a8594 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 5cbe7ad9-5124-4014-9d2a-e877493b2a9e] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:26:15.245450 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6f3c7c45-2193-4a76-a873-9eec035a8594 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:15.246064 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6f3c7c45-2193-4a76-a873-9eec035a8594 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:15.246406 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6f3c7c45-2193-4a76-a873-9eec035a8594 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:15.247131 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6f3c7c45-2193-4a76-a873-9eec035a8594 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:15.247583 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6f3c7c45-2193-4a76-a873-9eec035a8594 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:15.247987 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6f3c7c45-2193-4a76-a873-9eec035a8594 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:15.282155 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6f3c7c45-2193-4a76-a873-9eec035a8594 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:15.282678 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6f3c7c45-2193-4a76-a873-9eec035a8594 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:15.283111 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6f3c7c45-2193-4a76-a873-9eec035a8594 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:15.283693 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.objects.instance [None req-6f3c7c45-2193-4a76-a873-9eec035a8594 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lazy-loading 'fault' on Instance uuid 5cbe7ad9-5124-4014-9d2a-e877493b2a9e {{(pid=120782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:26:15.311017 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-54653c86-8ec7-4c3e-92ea-22e6fa548c8b tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/a279a105-ed85-45eb-9725-366e0cceb6d6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098580 Aug 27 02:26:15.311017 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 397/810] 10.222.0.61 () {58 vars in 1275 bytes} [Sat Aug 27 02:26:15 2022] GET /compute/v2.1/servers/a279a105-ed85-45eb-9725-366e0cceb6d6/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:26:15.334481 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-6f3c7c45-2193-4a76-a873-9eec035a8594 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:15.338327 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:26:15.346110 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-6f3c7c45-2193-4a76-a873-9eec035a8594 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e" status: 200 len: 1312 microversion: 2.1 time: 0.111772 Aug 27 02:26:15.347071 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 414/811] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:26:15 2022] GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e => generated 1312 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:26:16.368351 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-52b0a3da-1950-4d70-9c17-f66af6701272 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:26:16.369001 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-52b0a3da-1950-4d70-9c17-f66af6701272 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 5cbe7ad9-5124-4014-9d2a-e877493b2a9e] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:26:16.376326 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [req-60572ed9-311d-4a0e-a57c-44047e1e3248 req-e59ed14d-7e4a-4b04-8810-1c25ef0d8df7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a279a105-ed85-45eb-9725-366e0cceb6d6", "tag": "3eec6bbd-2647-430f-80b4-d136f3c0de5a"}]} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:26:16.376988 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-52b0a3da-1950-4d70-9c17-f66af6701272 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:16.377713 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-52b0a3da-1950-4d70-9c17-f66af6701272 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:16.378312 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-52b0a3da-1950-4d70-9c17-f66af6701272 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:16.379209 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-52b0a3da-1950-4d70-9c17-f66af6701272 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:16.379708 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-52b0a3da-1950-4d70-9c17-f66af6701272 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:16.380135 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-52b0a3da-1950-4d70-9c17-f66af6701272 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:16.386030 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-60572ed9-311d-4a0e-a57c-44047e1e3248 req-e59ed14d-7e4a-4b04-8810-1c25ef0d8df7 service nova] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:16.386505 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-60572ed9-311d-4a0e-a57c-44047e1e3248 req-e59ed14d-7e4a-4b04-8810-1c25ef0d8df7 service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:16.386931 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-60572ed9-311d-4a0e-a57c-44047e1e3248 req-e59ed14d-7e4a-4b04-8810-1c25ef0d8df7 service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:16.395562 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.wsgi [None req-52b0a3da-1950-4d70-9c17-f66af6701272 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] HTTP exception thrown: Instance 5cbe7ad9-5124-4014-9d2a-e877493b2a9e could not be found. Aug 27 02:26:16.397234 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-52b0a3da-1950-4d70-9c17-f66af6701272 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Request method failure captured: Aug 27 02:26:16.397234 dv-cinder-846303-3-smb devstack@n-api.service[120782]: request: GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e HTTP/1.1 Aug 27 02:26:16.397234 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Accept: application/json Aug 27 02:26:16.397234 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Accept-Encoding: identity Aug 27 02:26:16.397234 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Connection: close Aug 27 02:26:16.397234 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Content-Length: 0 Aug 27 02:26:16.397234 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Content-Type: application/json Aug 27 02:26:16.397234 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Host: 10.222.0.61 Aug 27 02:26:16.397234 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Openstack-System-Scope: None Aug 27 02:26:16.397234 dv-cinder-846303-3-smb devstack@n-api.service[120782]: User-Agent: python-urllib3/1.26.11 Aug 27 02:26:16.397234 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Auth-Token: gAAAAABjCX-CxsQboupe7LGVgMB3IvNk6DZKE8jyi_9nbzm-Wvf3iOAH1nHoxh235cCKiWLsOX-TSw1YO5xdAHVdx_5iwsz77LAdzGTVwjuAfG2PP9Jsj1PrgoZ4Q6XQRHgC6UAoTOMizINS2RlKs2CbHJ_FMN6pGKDTXTr1l-0RRb1mYFgkHEU Aug 27 02:26:16.397234 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Domain-Id: None Aug 27 02:26:16.397234 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Domain-Name: None Aug 27 02:26:16.397234 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Identity-Status: Confirmed Aug 27 02:26:16.397234 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Is-Admin-Project: True Aug 27 02:26:16.397234 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Domain-Id: default Aug 27 02:26:16.397234 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Domain-Name: Default Aug 27 02:26:16.397234 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Id: 67209b74f2fa4ae7ad9762d141378a5d Aug 27 02:26:16.397234 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1743925357 Aug 27 02:26:16.397234 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Role: member,reader Aug 27 02:26:16.397234 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Roles: member,reader Aug 27 02:26:16.398548 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/67209b74f2fa4ae7ad9762d141378a5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_67209b74f2fa4ae7ad9762d141378a5d", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/67209b74f2fa4ae7ad9762d141378a5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/67209b74f2fa4ae7ad9762d141378a5d"}]}] Aug 27 02:26:16.398548 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1743925357 Aug 27 02:26:16.398548 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Tenant-Id: 67209b74f2fa4ae7ad9762d141378a5d Aug 27 02:26:16.398548 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1743925357 Aug 27 02:26:16.398548 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User: tempest-ServerRescueNegativeTestJSON-1743925357-project Aug 27 02:26:16.398548 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Domain-Id: default Aug 27 02:26:16.398548 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Domain-Name: Default Aug 27 02:26:16.398548 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Id: 1eb664209056410d890d1b2b8bfa0155 Aug 27 02:26:16.398548 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1743925357-project Aug 27 02:26:16.398548 dv-cinder-846303-3-smb devstack@n-api.service[120782]: method: > Aug 27 02:26:16.398548 dv-cinder-846303-3-smb devstack@n-api.service[120782]: exception: Instance 5cbe7ad9-5124-4014-9d2a-e877493b2a9e could not be found. Aug 27 02:26:16.398548 dv-cinder-846303-3-smb devstack@n-api.service[120782]: action_args: {'id': '5cbe7ad9-5124-4014-9d2a-e877493b2a9e'} Aug 27 02:26:16.399319 dv-cinder-846303-3-smb devstack@n-api.service[120782]: {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:26:16.399319 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:26:16.399319 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:26:16.399319 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:26:16.399319 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:26:16.399319 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:26:16.399319 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:26:16.399319 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:26:16.399319 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:26:16.399319 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:26:16.399319 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5cbe7ad9-5124-4014-9d2a-e877493b2a9e could not be found. Aug 27 02:26:16.399319 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:26:16.399319 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:26:16.399319 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:26:16.399319 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:26:16.399319 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:26:16.399319 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:26:16.399319 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:26:16.399319 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:26:16.399319 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:26:16.400472 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:26:16.400472 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:26:16.400472 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:26:16.400472 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:26:16.400472 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:26:16.400472 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:26:16.400472 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:26:16.400472 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5cbe7ad9-5124-4014-9d2a-e877493b2a9e could not be found. Aug 27 02:26:16.400472 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:26:16.400472 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:26:16.400472 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:26:16.400472 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:26:16.400472 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:26:16.400472 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:26:16.400472 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:26:16.400472 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:26:16.400472 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5cbe7ad9-5124-4014-9d2a-e877493b2a9e could not be found. Aug 27 02:26:16.400472 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:26:16.401635 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-52b0a3da-1950-4d70-9c17-f66af6701272 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Returning 404 to user: Instance 5cbe7ad9-5124-4014-9d2a-e877493b2a9e could not be found. {{(pid=120782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:26:16.401635 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-52b0a3da-1950-4d70-9c17-f66af6701272 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e" status: 404 len: 111 microversion: 2.1 time: 0.036108 Aug 27 02:26:16.401789 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.compute.server_external_events [req-60572ed9-311d-4a0e-a57c-44047e1e3248 req-e59ed14d-7e4a-4b04-8810-1c25ef0d8df7 service nova] Creating event network-changed:3eec6bbd-2647-430f-80b4-d136f3c0de5a for instance a279a105-ed85-45eb-9725-366e0cceb6d6 on hv-cinder-84630 Aug 27 02:26:16.403264 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 415/812] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:26:16 2022] GET /compute/v2.1/servers/5cbe7ad9-5124-4014-9d2a-e877493b2a9e => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:26:16.404662 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [req-60572ed9-311d-4a0e-a57c-44047e1e3248 req-e59ed14d-7e4a-4b04-8810-1c25ef0d8df7 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087308 Aug 27 02:26:16.405478 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 398/813] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Aug 27 02:26:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:26:16.407574 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-9ed289cb-555d-44df-b6b5-f32d813aada0 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:26:16.407883 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-9ed289cb-555d-44df-b6b5-f32d813aada0 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 7122531d-d371-4c4c-8d9f-fc74be8649c1] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:26:16.414001 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9ed289cb-555d-44df-b6b5-f32d813aada0 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:16.414486 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9ed289cb-555d-44df-b6b5-f32d813aada0 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:16.414923 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9ed289cb-555d-44df-b6b5-f32d813aada0 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:16.415650 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9ed289cb-555d-44df-b6b5-f32d813aada0 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:16.416101 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9ed289cb-555d-44df-b6b5-f32d813aada0 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:16.416524 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9ed289cb-555d-44df-b6b5-f32d813aada0 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:16.442870 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-9ed289cb-555d-44df-b6b5-f32d813aada0 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 7122531d-d371-4c4c-8d9f-fc74be8649c1] Going to try to terminate instance {{(pid=120782) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:26:16.530556 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:26:16.550683 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-9ed289cb-555d-44df-b6b5-f32d813aada0 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "DELETE /compute/v2.1/servers/7122531d-d371-4c4c-8d9f-fc74be8649c1" status: 204 len: 0 microversion: 2.1 time: 0.146544 Aug 27 02:26:16.552007 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 416/814] 10.222.0.61 () {58 vars in 1239 bytes} [Sat Aug 27 02:26:16 2022] DELETE /compute/v2.1/servers/7122531d-d371-4c4c-8d9f-fc74be8649c1 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:26:16.561199 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-5bbd3445-cba3-4276-a979-b593c20cbff8 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:26:16.562091 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-5bbd3445-cba3-4276-a979-b593c20cbff8 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 7122531d-d371-4c4c-8d9f-fc74be8649c1] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:26:16.569383 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5bbd3445-cba3-4276-a979-b593c20cbff8 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:16.569856 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5bbd3445-cba3-4276-a979-b593c20cbff8 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:16.570374 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5bbd3445-cba3-4276-a979-b593c20cbff8 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:16.571162 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5bbd3445-cba3-4276-a979-b593c20cbff8 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:16.571844 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5bbd3445-cba3-4276-a979-b593c20cbff8 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:16.572386 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5bbd3445-cba3-4276-a979-b593c20cbff8 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:16.721683 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-5bbd3445-cba3-4276-a979-b593c20cbff8 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:16.729621 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-5bbd3445-cba3-4276-a979-b593c20cbff8 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/7122531d-d371-4c4c-8d9f-fc74be8649c1" status: 200 len: 1522 microversion: 2.1 time: 0.173414 Aug 27 02:26:16.730185 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 399/815] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:26:16 2022] GET /compute/v2.1/servers/7122531d-d371-4c4c-8d9f-fc74be8649c1 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:26:17.751700 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-d5cbe861-2614-4f5b-8dff-94d2d3a78b46 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:26:17.752386 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-d5cbe861-2614-4f5b-8dff-94d2d3a78b46 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 7122531d-d371-4c4c-8d9f-fc74be8649c1] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:26:17.759814 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d5cbe861-2614-4f5b-8dff-94d2d3a78b46 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:17.760291 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d5cbe861-2614-4f5b-8dff-94d2d3a78b46 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:17.760716 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d5cbe861-2614-4f5b-8dff-94d2d3a78b46 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:17.761420 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d5cbe861-2614-4f5b-8dff-94d2d3a78b46 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:17.761890 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d5cbe861-2614-4f5b-8dff-94d2d3a78b46 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:17.762306 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d5cbe861-2614-4f5b-8dff-94d2d3a78b46 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:17.901186 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-d5cbe861-2614-4f5b-8dff-94d2d3a78b46 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:17.910537 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-d5cbe861-2614-4f5b-8dff-94d2d3a78b46 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/7122531d-d371-4c4c-8d9f-fc74be8649c1" status: 200 len: 1522 microversion: 2.1 time: 0.163076 Aug 27 02:26:17.911214 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 417/816] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:26:17 2022] GET /compute/v2.1/servers/7122531d-d371-4c4c-8d9f-fc74be8649c1 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:26:18.938742 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-3e9645a3-e438-472f-9f53-696a4c8d24f9 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:26:18.939394 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-3e9645a3-e438-472f-9f53-696a4c8d24f9 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 7122531d-d371-4c4c-8d9f-fc74be8649c1] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:26:18.946745 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3e9645a3-e438-472f-9f53-696a4c8d24f9 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:18.947469 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3e9645a3-e438-472f-9f53-696a4c8d24f9 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:18.947994 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3e9645a3-e438-472f-9f53-696a4c8d24f9 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:18.948779 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3e9645a3-e438-472f-9f53-696a4c8d24f9 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:18.949290 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3e9645a3-e438-472f-9f53-696a4c8d24f9 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:18.949782 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3e9645a3-e438-472f-9f53-696a4c8d24f9 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:19.084847 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-3e9645a3-e438-472f-9f53-696a4c8d24f9 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:19.088368 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell1:SELECT=100 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:26:19.093892 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-3e9645a3-e438-472f-9f53-696a4c8d24f9 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/7122531d-d371-4c4c-8d9f-fc74be8649c1" status: 200 len: 1522 microversion: 2.1 time: 0.159685 Aug 27 02:26:19.094438 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 400/817] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:26:18 2022] GET /compute/v2.1/servers/7122531d-d371-4c4c-8d9f-fc74be8649c1 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:26:20.114950 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-763919a8-7503-4960-b1d0-26cc566413b1 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:26:20.115547 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-763919a8-7503-4960-b1d0-26cc566413b1 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 7122531d-d371-4c4c-8d9f-fc74be8649c1] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:26:20.122538 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-763919a8-7503-4960-b1d0-26cc566413b1 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:20.123165 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-763919a8-7503-4960-b1d0-26cc566413b1 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:20.123520 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-763919a8-7503-4960-b1d0-26cc566413b1 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:20.124201 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-763919a8-7503-4960-b1d0-26cc566413b1 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:20.124642 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-763919a8-7503-4960-b1d0-26cc566413b1 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:20.125091 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-763919a8-7503-4960-b1d0-26cc566413b1 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:20.258574 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-763919a8-7503-4960-b1d0-26cc566413b1 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:20.267203 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-763919a8-7503-4960-b1d0-26cc566413b1 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/7122531d-d371-4c4c-8d9f-fc74be8649c1" status: 200 len: 1522 microversion: 2.1 time: 0.156129 Aug 27 02:26:20.267772 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 418/818] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:26:20 2022] GET /compute/v2.1/servers/7122531d-d371-4c4c-8d9f-fc74be8649c1 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:26:21.289168 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-1fe5b4c1-067e-42d8-af82-3f172b5a4dbc tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:26:21.289922 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-1fe5b4c1-067e-42d8-af82-3f172b5a4dbc tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 7122531d-d371-4c4c-8d9f-fc74be8649c1] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:26:21.297337 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1fe5b4c1-067e-42d8-af82-3f172b5a4dbc tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:21.297869 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1fe5b4c1-067e-42d8-af82-3f172b5a4dbc tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:21.298314 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1fe5b4c1-067e-42d8-af82-3f172b5a4dbc tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:21.299050 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1fe5b4c1-067e-42d8-af82-3f172b5a4dbc tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:21.299507 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1fe5b4c1-067e-42d8-af82-3f172b5a4dbc tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:21.299931 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1fe5b4c1-067e-42d8-af82-3f172b5a4dbc tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:21.567870 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-1fe5b4c1-067e-42d8-af82-3f172b5a4dbc tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:21.576184 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-1fe5b4c1-067e-42d8-af82-3f172b5a4dbc tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/7122531d-d371-4c4c-8d9f-fc74be8649c1" status: 200 len: 1522 microversion: 2.1 time: 0.291395 Aug 27 02:26:21.576763 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 401/819] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:26:21 2022] GET /compute/v2.1/servers/7122531d-d371-4c4c-8d9f-fc74be8649c1 => generated 1522 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:26:21.791435 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [req-fb473d8f-b1a9-49ef-b159-835a888288ca req-0bc0ca38-5a54-48e7-bdbb-38d424d0ecec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7122531d-d371-4c4c-8d9f-fc74be8649c1", "name": "network-vif-deleted", "tag": "63727c00-4d29-4b7f-af52-6ef68d39f55e"}]} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:26:21.803809 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-fb473d8f-b1a9-49ef-b159-835a888288ca req-0bc0ca38-5a54-48e7-bdbb-38d424d0ecec service nova] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:21.804267 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-fb473d8f-b1a9-49ef-b159-835a888288ca req-0bc0ca38-5a54-48e7-bdbb-38d424d0ecec service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:21.804698 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-fb473d8f-b1a9-49ef-b159-835a888288ca req-0bc0ca38-5a54-48e7-bdbb-38d424d0ecec service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:21.818247 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.compute.server_external_events [req-fb473d8f-b1a9-49ef-b159-835a888288ca req-0bc0ca38-5a54-48e7-bdbb-38d424d0ecec service nova] Creating event network-vif-deleted:63727c00-4d29-4b7f-af52-6ef68d39f55e for instance 7122531d-d371-4c4c-8d9f-fc74be8649c1 on hv-cinder-84630 Aug 27 02:26:21.824029 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [req-fb473d8f-b1a9-49ef-b159-835a888288ca req-0bc0ca38-5a54-48e7-bdbb-38d424d0ecec service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036137 Aug 27 02:26:21.824778 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 419/820] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Aug 27 02:26:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:26:22.600257 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-20440f67-96aa-4b43-89d4-e9ff839b3e36 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:26:22.600858 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-20440f67-96aa-4b43-89d4-e9ff839b3e36 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 7122531d-d371-4c4c-8d9f-fc74be8649c1] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:26:22.610466 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-20440f67-96aa-4b43-89d4-e9ff839b3e36 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:22.611156 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-20440f67-96aa-4b43-89d4-e9ff839b3e36 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:22.611674 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-20440f67-96aa-4b43-89d4-e9ff839b3e36 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:22.612509 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-20440f67-96aa-4b43-89d4-e9ff839b3e36 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:22.612825 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-20440f67-96aa-4b43-89d4-e9ff839b3e36 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:22.613279 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-20440f67-96aa-4b43-89d4-e9ff839b3e36 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:22.647075 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-20440f67-96aa-4b43-89d4-e9ff839b3e36 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:22.647547 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-20440f67-96aa-4b43-89d4-e9ff839b3e36 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:22.647973 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-20440f67-96aa-4b43-89d4-e9ff839b3e36 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:22.648417 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.objects.instance [None req-20440f67-96aa-4b43-89d4-e9ff839b3e36 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lazy-loading 'fault' on Instance uuid 7122531d-d371-4c4c-8d9f-fc74be8649c1 {{(pid=120783) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:26:22.691383 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-20440f67-96aa-4b43-89d4-e9ff839b3e36 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb664209056410d890d1b2b8bfa0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67209b74f2fa4ae7ad9762d141378a5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:22.699637 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-20440f67-96aa-4b43-89d4-e9ff839b3e36 tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/7122531d-d371-4c4c-8d9f-fc74be8649c1" status: 200 len: 1312 microversion: 2.1 time: 0.104932 Aug 27 02:26:22.700335 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 402/821] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:26:22 2022] GET /compute/v2.1/servers/7122531d-d371-4c4c-8d9f-fc74be8649c1 => generated 1312 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:26:23.721829 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-ef2eacc7-16e2-45d8-b8bd-43eea266f76f tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:26:23.722511 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-ef2eacc7-16e2-45d8-b8bd-43eea266f76f tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] [instance: 7122531d-d371-4c4c-8d9f-fc74be8649c1] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:26:23.730342 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ef2eacc7-16e2-45d8-b8bd-43eea266f76f tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:23.730824 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ef2eacc7-16e2-45d8-b8bd-43eea266f76f tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:23.731283 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ef2eacc7-16e2-45d8-b8bd-43eea266f76f tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:23.731989 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ef2eacc7-16e2-45d8-b8bd-43eea266f76f tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:23.732436 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ef2eacc7-16e2-45d8-b8bd-43eea266f76f tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:23.732851 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ef2eacc7-16e2-45d8-b8bd-43eea266f76f tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:23.746941 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.wsgi [None req-ef2eacc7-16e2-45d8-b8bd-43eea266f76f tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] HTTP exception thrown: Instance 7122531d-d371-4c4c-8d9f-fc74be8649c1 could not be found. Aug 27 02:26:23.748643 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-ef2eacc7-16e2-45d8-b8bd-43eea266f76f tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Request method failure captured: Aug 27 02:26:23.748643 dv-cinder-846303-3-smb devstack@n-api.service[120782]: request: GET /compute/v2.1/servers/7122531d-d371-4c4c-8d9f-fc74be8649c1 HTTP/1.1 Aug 27 02:26:23.748643 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Accept: application/json Aug 27 02:26:23.748643 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Accept-Encoding: identity Aug 27 02:26:23.748643 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Connection: close Aug 27 02:26:23.748643 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Content-Length: 0 Aug 27 02:26:23.748643 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Content-Type: application/json Aug 27 02:26:23.748643 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Host: 10.222.0.61 Aug 27 02:26:23.748643 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Openstack-System-Scope: None Aug 27 02:26:23.748643 dv-cinder-846303-3-smb devstack@n-api.service[120782]: User-Agent: python-urllib3/1.26.11 Aug 27 02:26:23.748643 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Auth-Token: gAAAAABjCX-CxsQboupe7LGVgMB3IvNk6DZKE8jyi_9nbzm-Wvf3iOAH1nHoxh235cCKiWLsOX-TSw1YO5xdAHVdx_5iwsz77LAdzGTVwjuAfG2PP9Jsj1PrgoZ4Q6XQRHgC6UAoTOMizINS2RlKs2CbHJ_FMN6pGKDTXTr1l-0RRb1mYFgkHEU Aug 27 02:26:23.748643 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Domain-Id: None Aug 27 02:26:23.748643 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Domain-Name: None Aug 27 02:26:23.748643 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Identity-Status: Confirmed Aug 27 02:26:23.748643 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Is-Admin-Project: True Aug 27 02:26:23.748643 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Domain-Id: default Aug 27 02:26:23.748643 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Domain-Name: Default Aug 27 02:26:23.748643 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Id: 67209b74f2fa4ae7ad9762d141378a5d Aug 27 02:26:23.748643 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1743925357 Aug 27 02:26:23.748643 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Role: member,reader Aug 27 02:26:23.748643 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Roles: member,reader Aug 27 02:26:23.750253 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/67209b74f2fa4ae7ad9762d141378a5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_67209b74f2fa4ae7ad9762d141378a5d", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/67209b74f2fa4ae7ad9762d141378a5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/67209b74f2fa4ae7ad9762d141378a5d"}]}] Aug 27 02:26:23.750253 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1743925357 Aug 27 02:26:23.750253 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Tenant-Id: 67209b74f2fa4ae7ad9762d141378a5d Aug 27 02:26:23.750253 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1743925357 Aug 27 02:26:23.750253 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User: tempest-ServerRescueNegativeTestJSON-1743925357-project Aug 27 02:26:23.750253 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Domain-Id: default Aug 27 02:26:23.750253 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Domain-Name: Default Aug 27 02:26:23.750253 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Id: 1eb664209056410d890d1b2b8bfa0155 Aug 27 02:26:23.750253 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1743925357-project Aug 27 02:26:23.750253 dv-cinder-846303-3-smb devstack@n-api.service[120782]: method: > Aug 27 02:26:23.750253 dv-cinder-846303-3-smb devstack@n-api.service[120782]: exception: Instance 7122531d-d371-4c4c-8d9f-fc74be8649c1 could not be found. Aug 27 02:26:23.750253 dv-cinder-846303-3-smb devstack@n-api.service[120782]: action_args: {'id': '7122531d-d371-4c4c-8d9f-fc74be8649c1'} Aug 27 02:26:23.751023 dv-cinder-846303-3-smb devstack@n-api.service[120782]: {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:26:23.751023 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:26:23.751023 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:26:23.751023 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:26:23.751023 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:26:23.751023 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:26:23.751023 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:26:23.751023 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:26:23.751023 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:26:23.751023 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:26:23.751023 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7122531d-d371-4c4c-8d9f-fc74be8649c1 could not be found. Aug 27 02:26:23.751023 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:26:23.751023 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:26:23.751023 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:26:23.751023 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:26:23.751023 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:26:23.751023 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:26:23.751023 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:26:23.751023 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:26:23.751023 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:26:23.752534 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:26:23.752534 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:26:23.752534 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:26:23.752534 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:26:23.752534 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:26:23.752534 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:26:23.752534 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:26:23.752534 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7122531d-d371-4c4c-8d9f-fc74be8649c1 could not be found. Aug 27 02:26:23.752534 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:26:23.752534 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:26:23.752534 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:26:23.752534 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:26:23.752534 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:26:23.752534 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:26:23.752534 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:26:23.752534 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:26:23.752534 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7122531d-d371-4c4c-8d9f-fc74be8649c1 could not be found. Aug 27 02:26:23.752534 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:26:23.754461 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-ef2eacc7-16e2-45d8-b8bd-43eea266f76f tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] Returning 404 to user: Instance 7122531d-d371-4c4c-8d9f-fc74be8649c1 could not be found. {{(pid=120782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:26:23.754461 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-ef2eacc7-16e2-45d8-b8bd-43eea266f76f tempest-ServerRescueNegativeTestJSON-1743925357 tempest-ServerRescueNegativeTestJSON-1743925357-project] 10.222.0.61 "GET /compute/v2.1/servers/7122531d-d371-4c4c-8d9f-fc74be8649c1" status: 404 len: 111 microversion: 2.1 time: 0.032741 Aug 27 02:26:23.754461 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 420/822] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:26:23 2022] GET /compute/v2.1/servers/7122531d-d371-4c4c-8d9f-fc74be8649c1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:26:24.037606 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-72ccf51c-b49a-401c-b2d6-ae174c265cc5 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1609678071"}} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:26:24.038207 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-72ccf51c-b49a-401c-b2d6-ae174c265cc5 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] [instance: 49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:26:24.045683 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-72ccf51c-b49a-401c-b2d6-ae174c265cc5 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:24.046245 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-72ccf51c-b49a-401c-b2d6-ae174c265cc5 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:24.046733 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-72ccf51c-b49a-401c-b2d6-ae174c265cc5 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:24.047938 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-72ccf51c-b49a-401c-b2d6-ae174c265cc5 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:24.048552 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-72ccf51c-b49a-401c-b2d6-ae174c265cc5 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:24.049176 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-72ccf51c-b49a-401c-b2d6-ae174c265cc5 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:24.201166 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.network.security_group_api [None req-72ccf51c-b49a-401c-b2d6-ae174c265cc5 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Removing security group ca4833a0-5f44-4d56-8bcf-e04f514ce92b from port d60d4774-8401-4c3b-b403-1555799f9a3f Aug 27 02:26:24.527236 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-72ccf51c-b49a-401c-b2d6-ae174c265cc5 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] 10.222.0.61 "POST /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8/action" status: 202 len: 0 microversion: 2.1 time: 0.493865 Aug 27 02:26:24.532012 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 403/823] 10.222.0.61 () {60 vars in 1278 bytes} [Sat Aug 27 02:26:24 2022] POST /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8/action => generated 0 bytes in 499 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:26:24.534933 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [req-a26d7c17-6bbd-40bb-abbe-6991d0765ac7 req-dd54667d-10e0-4530-8049-908253790245 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8", "tag": "d60d4774-8401-4c3b-b403-1555799f9a3f"}]} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:26:24.544848 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-a26d7c17-6bbd-40bb-abbe-6991d0765ac7 req-dd54667d-10e0-4530-8049-908253790245 service nova] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:24.546669 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-a26d7c17-6bbd-40bb-abbe-6991d0765ac7 req-dd54667d-10e0-4530-8049-908253790245 service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:24.547037 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-a26d7c17-6bbd-40bb-abbe-6991d0765ac7 req-dd54667d-10e0-4530-8049-908253790245 service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:24.559213 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.compute.server_external_events [req-a26d7c17-6bbd-40bb-abbe-6991d0765ac7 req-dd54667d-10e0-4530-8049-908253790245 service nova] Creating event network-changed:d60d4774-8401-4c3b-b403-1555799f9a3f for instance 49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8 on hv-cinder-84630 Aug 27 02:26:24.564339 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [req-a26d7c17-6bbd-40bb-abbe-6991d0765ac7 req-dd54667d-10e0-4530-8049-908253790245 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033211 Aug 27 02:26:24.565243 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 421/824] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Aug 27 02:26:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:26:26.110727 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-eedfac4c-4655-4833-a6a3-ae365767af75 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:26:26.111353 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-eedfac4c-4655-4833-a6a3-ae365767af75 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] [instance: 49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:26:26.118094 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-eedfac4c-4655-4833-a6a3-ae365767af75 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:26.118863 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-eedfac4c-4655-4833-a6a3-ae365767af75 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:26.119472 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-eedfac4c-4655-4833-a6a3-ae365767af75 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:26.120340 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-eedfac4c-4655-4833-a6a3-ae365767af75 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:26.121044 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-eedfac4c-4655-4833-a6a3-ae365767af75 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:26.121855 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-eedfac4c-4655-4833-a6a3-ae365767af75 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:26.228471 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.objects.instance [None req-eedfac4c-4655-4833-a6a3-ae365767af75 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lazy-loading 'services' on Instance uuid 49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8 {{(pid=120783) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:26:26.332666 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-eedfac4c-4655-4833-a6a3-ae365767af75 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] 10.222.0.61 "DELETE /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8/os-volume_attachments/313ad542-6e20-40f6-ac89-fb7d78a31cab" status: 202 len: 0 microversion: 2.1 time: 0.226242 Aug 27 02:26:26.344748 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-c00c31be-402b-4bb0-9ef3-9bf0f567ce65 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:26:26.348640 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 404/825] 10.222.0.61 () {58 vars in 1416 bytes} [Sat Aug 27 02:26:26 2022] DELETE /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8/os-volume_attachments/313ad542-6e20-40f6-ac89-fb7d78a31cab => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:26:26.349035 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-c00c31be-402b-4bb0-9ef3-9bf0f567ce65 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] [instance: 49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:26:26.367816 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c00c31be-402b-4bb0-9ef3-9bf0f567ce65 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:26.368540 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c00c31be-402b-4bb0-9ef3-9bf0f567ce65 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:26.369150 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c00c31be-402b-4bb0-9ef3-9bf0f567ce65 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:26.370296 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c00c31be-402b-4bb0-9ef3-9bf0f567ce65 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:26.371010 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c00c31be-402b-4bb0-9ef3-9bf0f567ce65 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:26.371516 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c00c31be-402b-4bb0-9ef3-9bf0f567ce65 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:26.422887 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-c00c31be-402b-4bb0-9ef3-9bf0f567ce65 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] 10.222.0.61 "GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083452 Aug 27 02:26:26.424312 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 422/826] 10.222.0.61 () {58 vars in 1302 bytes} [Sat Aug 27 02:26:26 2022] GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:26:26.580341 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [req-141c69da-e9e5-4eef-8450-9ba6abf01169 req-d852a8a5-2156-4a19-a47a-36949156125e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8", "tag": "d60d4774-8401-4c3b-b403-1555799f9a3f"}]} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:26:26.591809 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-141c69da-e9e5-4eef-8450-9ba6abf01169 req-d852a8a5-2156-4a19-a47a-36949156125e service nova] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:26.593088 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-141c69da-e9e5-4eef-8450-9ba6abf01169 req-d852a8a5-2156-4a19-a47a-36949156125e service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:26.593702 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-141c69da-e9e5-4eef-8450-9ba6abf01169 req-d852a8a5-2156-4a19-a47a-36949156125e service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:26.606064 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.compute.server_external_events [req-141c69da-e9e5-4eef-8450-9ba6abf01169 req-d852a8a5-2156-4a19-a47a-36949156125e service nova] Creating event network-changed:d60d4774-8401-4c3b-b403-1555799f9a3f for instance 49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8 on hv-cinder-84630 Aug 27 02:26:26.611758 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [req-141c69da-e9e5-4eef-8450-9ba6abf01169 req-d852a8a5-2156-4a19-a47a-36949156125e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035625 Aug 27 02:26:26.613139 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 405/827] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Aug 27 02:26:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:26:27.436707 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-82a224ec-613b-4588-9271-d65813a82ec0 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:26:27.440286 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-82a224ec-613b-4588-9271-d65813a82ec0 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] [instance: 49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:26:27.448344 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-82a224ec-613b-4588-9271-d65813a82ec0 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:27.449127 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-82a224ec-613b-4588-9271-d65813a82ec0 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:27.450014 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-82a224ec-613b-4588-9271-d65813a82ec0 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:27.450889 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-82a224ec-613b-4588-9271-d65813a82ec0 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:27.451673 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-82a224ec-613b-4588-9271-d65813a82ec0 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:27.452302 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-82a224ec-613b-4588-9271-d65813a82ec0 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:27.494112 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-82a224ec-613b-4588-9271-d65813a82ec0 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] 10.222.0.61 "GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.061278 Aug 27 02:26:27.498201 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 423/828] 10.222.0.61 () {58 vars in 1302 bytes} [Sat Aug 27 02:26:27 2022] GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8/os-volume_attachments => generated 25 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:26:27.513279 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-20183aa7-342c-4ed6-a459-948ba0af7e3d tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:26:27.514183 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-20183aa7-342c-4ed6-a459-948ba0af7e3d tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] [instance: 49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:26:27.525424 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-20183aa7-342c-4ed6-a459-948ba0af7e3d tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:27.530197 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-20183aa7-342c-4ed6-a459-948ba0af7e3d tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:27.530646 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-20183aa7-342c-4ed6-a459-948ba0af7e3d tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:27.534403 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-20183aa7-342c-4ed6-a459-948ba0af7e3d tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:27.534910 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-20183aa7-342c-4ed6-a459-948ba0af7e3d tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:27.535350 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-20183aa7-342c-4ed6-a459-948ba0af7e3d tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:27.763916 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.wsgi [None req-20183aa7-342c-4ed6-a459-948ba0af7e3d tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] HTTP exception thrown: Instance 49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8 is not attached to volume 313ad542-6e20-40f6-ac89-fb7d78a31cab Aug 27 02:26:27.772438 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-20183aa7-342c-4ed6-a459-948ba0af7e3d tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Request method failure captured: Aug 27 02:26:27.772438 dv-cinder-846303-3-smb devstack@n-api.service[120783]: request: DELETE /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8/os-volume_attachments/313ad542-6e20-40f6-ac89-fb7d78a31cab HTTP/1.1 Aug 27 02:26:27.772438 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Accept: application/json Aug 27 02:26:27.772438 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Accept-Encoding: identity Aug 27 02:26:27.772438 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Connection: close Aug 27 02:26:27.772438 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Content-Length: 0 Aug 27 02:26:27.772438 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Content-Type: application/json Aug 27 02:26:27.772438 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Host: 10.222.0.61 Aug 27 02:26:27.772438 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Openstack-System-Scope: None Aug 27 02:26:27.772438 dv-cinder-846303-3-smb devstack@n-api.service[120783]: User-Agent: python-urllib3/1.26.11 Aug 27 02:26:27.772438 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Auth-Token: gAAAAABjCX__DPIuDv91nBIIAvPY_xgZFXgRji7HXckBVWMKkwW7fQ1ns9VxjvDKnac6X4G2Z9rkWKuBHRivbp6HS_7_RVJESt03MFh7J-gKuk9ntTJvMnT6rBUg8N1QT8PDuiBQmS_c-XMxGaKLZJGHBF_GV0m2NQtUYAoyNJ8polKveF_foIs Aug 27 02:26:27.772438 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Domain-Id: None Aug 27 02:26:27.772438 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Domain-Name: None Aug 27 02:26:27.772438 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Identity-Status: Confirmed Aug 27 02:26:27.772438 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Is-Admin-Project: True Aug 27 02:26:27.772438 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Project-Domain-Id: default Aug 27 02:26:27.772438 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Project-Domain-Name: Default Aug 27 02:26:27.772438 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Project-Id: fe4f956d4d27437c830871f6634a3018 Aug 27 02:26:27.772438 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Project-Name: tempest-TestMinimumBasicScenario-50349326 Aug 27 02:26:27.772438 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Role: member,reader Aug 27 02:26:27.772438 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Roles: member,reader Aug 27 02:26:27.774281 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/fe4f956d4d27437c830871f6634a3018"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_fe4f956d4d27437c830871f6634a3018", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fe4f956d4d27437c830871f6634a3018"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fe4f956d4d27437c830871f6634a3018"}]}] Aug 27 02:26:27.774281 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Tenant: tempest-TestMinimumBasicScenario-50349326 Aug 27 02:26:27.774281 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Tenant-Id: fe4f956d4d27437c830871f6634a3018 Aug 27 02:26:27.774281 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Tenant-Name: tempest-TestMinimumBasicScenario-50349326 Aug 27 02:26:27.774281 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User: tempest-TestMinimumBasicScenario-50349326-project Aug 27 02:26:27.774281 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User-Domain-Id: default Aug 27 02:26:27.774281 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User-Domain-Name: Default Aug 27 02:26:27.774281 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User-Id: 931dcabba0214e3daa878f31cd1706cc Aug 27 02:26:27.774281 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User-Name: tempest-TestMinimumBasicScenario-50349326-project Aug 27 02:26:27.774281 dv-cinder-846303-3-smb devstack@n-api.service[120783]: method: > Aug 27 02:26:27.774281 dv-cinder-846303-3-smb devstack@n-api.service[120783]: exception: Instance 49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8 is not attached to volume 313ad542-6e20-40f6-ac89-fb7d78a31cab Aug 27 02:26:27.777765 dv-cinder-846303-3-smb devstack@n-api.service[120783]: action_args: {'server_id': '49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8', 'id': '313ad542-6e20-40f6-ac89-fb7d78a31cab'} Aug 27 02:26:27.777765 dv-cinder-846303-3-smb devstack@n-api.service[120783]: {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:26:27.777765 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:26:27.777765 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 27 02:26:27.777765 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 27 02:26:27.777765 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 02:26:27.777765 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 02:26:27.777765 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 27 02:26:27.777765 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 27 02:26:27.777765 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 313ad542-6e20-40f6-ac89-fb7d78a31cab. Aug 27 02:26:27.777765 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:26:27.777765 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:26:27.777765 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:26:27.777765 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:26:27.777765 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:26:27.777765 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:26:27.777765 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:26:27.777765 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:26:27.777765 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:26:27.779366 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:26:27.779366 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 27 02:26:27.779366 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 27 02:26:27.779366 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8 is not attached to volume 313ad542-6e20-40f6-ac89-fb7d78a31cab Aug 27 02:26:27.779366 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:26:27.779366 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:26:27.779366 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:26:27.779366 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:26:27.779366 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:26:27.779366 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:26:27.779366 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:26:27.779366 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:26:27.779366 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8 is not attached to volume 313ad542-6e20-40f6-ac89-fb7d78a31cab Aug 27 02:26:27.779366 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:26:27.779366 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-20183aa7-342c-4ed6-a459-948ba0af7e3d tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Returning 404 to user: Instance 49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8 is not attached to volume 313ad542-6e20-40f6-ac89-fb7d78a31cab {{(pid=120783) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:26:27.780730 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-20183aa7-342c-4ed6-a459-948ba0af7e3d tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] 10.222.0.61 "DELETE /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8/os-volume_attachments/313ad542-6e20-40f6-ac89-fb7d78a31cab" status: 404 len: 154 microversion: 2.1 time: 0.265416 Aug 27 02:26:27.780730 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 406/829] 10.222.0.61 () {58 vars in 1416 bytes} [Sat Aug 27 02:26:27 2022] DELETE /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8/os-volume_attachments/313ad542-6e20-40f6-ac89-fb7d78a31cab => generated 154 bytes in 267 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:26:28.954405 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-ccb3b645-4bb8-4338-b6dd-c3920fdbf811 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:26:28.954961 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-ccb3b645-4bb8-4338-b6dd-c3920fdbf811 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] [instance: 49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:26:28.961815 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ccb3b645-4bb8-4338-b6dd-c3920fdbf811 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:28.962294 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ccb3b645-4bb8-4338-b6dd-c3920fdbf811 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:28.962730 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ccb3b645-4bb8-4338-b6dd-c3920fdbf811 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:28.963465 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ccb3b645-4bb8-4338-b6dd-c3920fdbf811 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:28.963896 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ccb3b645-4bb8-4338-b6dd-c3920fdbf811 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:28.964315 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ccb3b645-4bb8-4338-b6dd-c3920fdbf811 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:28.991453 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-ccb3b645-4bb8-4338-b6dd-c3920fdbf811 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] [instance: 49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8] Going to try to terminate instance {{(pid=120782) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:26:29.093757 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-ccb3b645-4bb8-4338-b6dd-c3920fdbf811 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] 10.222.0.61 "DELETE /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8" status: 204 len: 0 microversion: 2.1 time: 0.142487 Aug 27 02:26:29.094759 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 424/830] 10.222.0.61 () {58 vars in 1239 bytes} [Sat Aug 27 02:26:28 2022] DELETE /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:26:29.104710 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-f529770c-3c95-4a9d-8258-b20df834e040 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:26:29.105332 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-f529770c-3c95-4a9d-8258-b20df834e040 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] [instance: 49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:26:29.111560 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f529770c-3c95-4a9d-8258-b20df834e040 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:29.112038 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f529770c-3c95-4a9d-8258-b20df834e040 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:29.113045 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f529770c-3c95-4a9d-8258-b20df834e040 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:29.113212 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f529770c-3c95-4a9d-8258-b20df834e040 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:29.113671 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f529770c-3c95-4a9d-8258-b20df834e040 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:29.114091 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f529770c-3c95-4a9d-8258-b20df834e040 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:29.253300 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-f529770c-3c95-4a9d-8258-b20df834e040 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931dcabba0214e3daa878f31cd1706cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f956d4d27437c830871f6634a3018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:29.255878 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-3d17813d-0f56-4e9d-8f7d-c72326377a39 tempest-VolumesGetTestJSON-513904272 tempest-VolumesGetTestJSON-513904272-project] Action: 'create', calling method: .version_select at 0x7fd80846f430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1300026234", "metadata": {"Type": "work"}}} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:26:29.262070 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-f529770c-3c95-4a9d-8258-b20df834e040 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] 10.222.0.61 "GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8" status: 200 len: 1552 microversion: 2.1 time: 0.162481 Aug 27 02:26:29.262913 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 407/831] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:26:29 2022] GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8 => generated 1552 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:26:29.575650 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-3d17813d-0f56-4e9d-8f7d-c72326377a39 tempest-VolumesGetTestJSON-513904272 tempest-VolumesGetTestJSON-513904272-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.457397 Aug 27 02:26:29.579639 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 425/832] 10.222.0.61 () {60 vars in 1156 bytes} [Sat Aug 27 02:26:29 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 463 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Aug 27 02:26:29.594068 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-4bf195a0-4bbc-4762-8064-fcbe8b9300a5 tempest-VolumesGetTestJSON-513904272 tempest-VolumesGetTestJSON-513904272-project] Calling method '.version_select at 0x7fd808436d30>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:26:29.657991 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-4bf195a0-4bbc-4762-8064-fcbe8b9300a5 tempest-VolumesGetTestJSON-513904272 tempest-VolumesGetTestJSON-513904272-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/f45f1538-2900-4bdc-a49a-1341ce072cd0" status: 200 len: 353 microversion: 2.1 time: 0.067829 Aug 27 02:26:29.658707 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 408/833] 10.222.0.61 () {58 vars in 1245 bytes} [Sat Aug 27 02:26:29 2022] GET /compute/v2.1/os-volumes/f45f1538-2900-4bdc-a49a-1341ce072cd0 => generated 353 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:26:29.788174 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-cce2561b-c88b-4118-a3e9-92c470d8589c tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:26:29.789197 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-cce2561b-c88b-4118-a3e9-92c470d8589c tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 99f2f366-4776-427e-99cf-79399835f2c8] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:26:29.799860 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cce2561b-c88b-4118-a3e9-92c470d8589c tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:29.800662 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cce2561b-c88b-4118-a3e9-92c470d8589c tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:29.801446 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cce2561b-c88b-4118-a3e9-92c470d8589c tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:29.802587 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cce2561b-c88b-4118-a3e9-92c470d8589c tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:29.803204 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cce2561b-c88b-4118-a3e9-92c470d8589c tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:29.803617 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cce2561b-c88b-4118-a3e9-92c470d8589c tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:29.832179 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-cce2561b-c88b-4118-a3e9-92c470d8589c tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8/ips" status: 200 len: 151 microversion: 2.20 time: 0.150022 Aug 27 02:26:29.832756 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 426/834] 10.222.0.61 () {60 vars in 1289 bytes} [Sat Aug 27 02:26:29 2022] GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8/ips => generated 151 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:26:30.285281 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-fb376be9-a329-4a2b-987d-e8efe768669d tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:26:30.286300 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-fb376be9-a329-4a2b-987d-e8efe768669d tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] [instance: 49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:26:30.293324 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fb376be9-a329-4a2b-987d-e8efe768669d tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:30.293838 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fb376be9-a329-4a2b-987d-e8efe768669d tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:30.294252 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fb376be9-a329-4a2b-987d-e8efe768669d tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:30.295051 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fb376be9-a329-4a2b-987d-e8efe768669d tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:30.295506 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fb376be9-a329-4a2b-987d-e8efe768669d tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:30.296042 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fb376be9-a329-4a2b-987d-e8efe768669d tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:30.453357 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-fb376be9-a329-4a2b-987d-e8efe768669d tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931dcabba0214e3daa878f31cd1706cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f956d4d27437c830871f6634a3018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:30.461354 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-fb376be9-a329-4a2b-987d-e8efe768669d tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] 10.222.0.61 "GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8" status: 200 len: 1552 microversion: 2.1 time: 0.181175 Aug 27 02:26:30.461948 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 409/835] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:26:30 2022] GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8 => generated 1552 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:26:30.672736 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-54173aa8-ada8-423b-ad01-de592bc8640e tempest-VolumesGetTestJSON-513904272 tempest-VolumesGetTestJSON-513904272-project] Calling method '.version_select at 0x7fd80846fca0>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:26:30.730619 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-54173aa8-ada8-423b-ad01-de592bc8640e tempest-VolumesGetTestJSON-513904272 tempest-VolumesGetTestJSON-513904272-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/f45f1538-2900-4bdc-a49a-1341ce072cd0" status: 200 len: 354 microversion: 2.1 time: 0.061676 Aug 27 02:26:30.731365 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 427/836] 10.222.0.61 () {58 vars in 1245 bytes} [Sat Aug 27 02:26:30 2022] GET /compute/v2.1/os-volumes/f45f1538-2900-4bdc-a49a-1341ce072cd0 => generated 354 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:26:30.747244 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-52e1ac49-b1f8-435d-8923-d37fad46cbe3 tempest-VolumesGetTestJSON-513904272 tempest-VolumesGetTestJSON-513904272-project] Calling method '.version_select at 0x7fd8099ea430>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:26:30.797452 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-52e1ac49-b1f8-435d-8923-d37fad46cbe3 tempest-VolumesGetTestJSON-513904272 tempest-VolumesGetTestJSON-513904272-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/f45f1538-2900-4bdc-a49a-1341ce072cd0" status: 200 len: 354 microversion: 2.1 time: 0.054478 Aug 27 02:26:30.798220 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 410/837] 10.222.0.61 () {58 vars in 1245 bytes} [Sat Aug 27 02:26:30 2022] GET /compute/v2.1/os-volumes/f45f1538-2900-4bdc-a49a-1341ce072cd0 => generated 354 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:26:30.815793 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-beed997a-cd3e-4854-be9f-a4960111c372 tempest-VolumesGetTestJSON-513904272 tempest-VolumesGetTestJSON-513904272-project] Calling method '.version_select at 0x7fd80838d4c0>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:26:30.879480 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-beed997a-cd3e-4854-be9f-a4960111c372 tempest-VolumesGetTestJSON-513904272 tempest-VolumesGetTestJSON-513904272-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/f45f1538-2900-4bdc-a49a-1341ce072cd0" status: 202 len: 0 microversion: 2.1 time: 0.067569 Aug 27 02:26:30.880091 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 428/838] 10.222.0.61 () {58 vars in 1248 bytes} [Sat Aug 27 02:26:30 2022] DELETE /compute/v2.1/os-volumes/f45f1538-2900-4bdc-a49a-1341ce072cd0 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:26:30.890363 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-a34bcc97-9962-4bda-8799-a4a11deb5507 tempest-VolumesGetTestJSON-513904272 tempest-VolumesGetTestJSON-513904272-project] Calling method '.version_select at 0x7fd8084448b0>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:26:30.938847 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-a34bcc97-9962-4bda-8799-a4a11deb5507 tempest-VolumesGetTestJSON-513904272 tempest-VolumesGetTestJSON-513904272-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/f45f1538-2900-4bdc-a49a-1341ce072cd0" status: 200 len: 353 microversion: 2.1 time: 0.054191 Aug 27 02:26:30.939498 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 411/839] 10.222.0.61 () {58 vars in 1245 bytes} [Sat Aug 27 02:26:30 2022] GET /compute/v2.1/os-volumes/f45f1538-2900-4bdc-a49a-1341ce072cd0 => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:26:31.481773 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-e58a1224-118f-43be-bb1e-ded29995aae8 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:26:31.482285 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-e58a1224-118f-43be-bb1e-ded29995aae8 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] [instance: 49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:26:31.491356 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e58a1224-118f-43be-bb1e-ded29995aae8 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:31.491842 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e58a1224-118f-43be-bb1e-ded29995aae8 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:31.492272 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e58a1224-118f-43be-bb1e-ded29995aae8 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:31.492954 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e58a1224-118f-43be-bb1e-ded29995aae8 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:31.493444 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e58a1224-118f-43be-bb1e-ded29995aae8 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:31.493861 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e58a1224-118f-43be-bb1e-ded29995aae8 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:31.658636 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-e58a1224-118f-43be-bb1e-ded29995aae8 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931dcabba0214e3daa878f31cd1706cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f956d4d27437c830871f6634a3018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:31.666955 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-e58a1224-118f-43be-bb1e-ded29995aae8 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] 10.222.0.61 "GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8" status: 200 len: 1552 microversion: 2.1 time: 0.189198 Aug 27 02:26:31.667507 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 429/840] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:26:31 2022] GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8 => generated 1552 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:26:31.953825 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-50e3ff49-27f2-4148-9288-aa64eb33b7c6 tempest-VolumesGetTestJSON-513904272 tempest-VolumesGetTestJSON-513904272-project] Calling method '.version_select at 0x7fd8082190d0>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:26:31.985076 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.wsgi [None req-50e3ff49-27f2-4148-9288-aa64eb33b7c6 tempest-VolumesGetTestJSON-513904272 tempest-VolumesGetTestJSON-513904272-project] HTTP exception thrown: Volume f45f1538-2900-4bdc-a49a-1341ce072cd0 could not be found. Aug 27 02:26:31.988370 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-50e3ff49-27f2-4148-9288-aa64eb33b7c6 tempest-VolumesGetTestJSON-513904272 tempest-VolumesGetTestJSON-513904272-project] Request method failure captured: Aug 27 02:26:31.988370 dv-cinder-846303-3-smb devstack@n-api.service[120783]: request: GET /compute/v2.1/os-volumes/f45f1538-2900-4bdc-a49a-1341ce072cd0 HTTP/1.1 Aug 27 02:26:31.988370 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Accept: application/json Aug 27 02:26:31.988370 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Accept-Encoding: identity Aug 27 02:26:31.988370 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Connection: close Aug 27 02:26:31.988370 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Content-Length: 0 Aug 27 02:26:31.988370 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Content-Type: application/json Aug 27 02:26:31.988370 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Host: 10.222.0.61 Aug 27 02:26:31.988370 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Openstack-System-Scope: None Aug 27 02:26:31.988370 dv-cinder-846303-3-smb devstack@n-api.service[120783]: User-Agent: python-urllib3/1.26.11 Aug 27 02:26:31.988370 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Auth-Token: gAAAAABjCYDVo3SIWMPOlqUmsKQ95hHXOSIZMsGqUtSU5v4JNsY81Ps_ZiCY_mztzfCfHqOd2ynfl-x778Y9eag4blmI9Fdi36x3jTSr0O5kfNZvGnMXjBJ6HdC7RTCTThhNXhHybFeqb7M8uW8cLA4Gde1JSwjSUQTmSB3or5R9h94rGAPriZ4 Aug 27 02:26:31.988370 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Domain-Id: None Aug 27 02:26:31.988370 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Domain-Name: None Aug 27 02:26:31.988370 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Identity-Status: Confirmed Aug 27 02:26:31.988370 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Is-Admin-Project: True Aug 27 02:26:31.988370 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Project-Domain-Id: default Aug 27 02:26:31.988370 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Project-Domain-Name: Default Aug 27 02:26:31.988370 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Project-Id: 93a9b3af642741029900bef04a4ea40c Aug 27 02:26:31.988370 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Project-Name: tempest-VolumesGetTestJSON-513904272 Aug 27 02:26:31.988370 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Role: member,reader Aug 27 02:26:31.988370 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Roles: member,reader Aug 27 02:26:31.990063 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/93a9b3af642741029900bef04a4ea40c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_93a9b3af642741029900bef04a4ea40c", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/93a9b3af642741029900bef04a4ea40c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/93a9b3af642741029900bef04a4ea40c"}]}] Aug 27 02:26:31.990063 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Tenant: tempest-VolumesGetTestJSON-513904272 Aug 27 02:26:31.990063 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Tenant-Id: 93a9b3af642741029900bef04a4ea40c Aug 27 02:26:31.990063 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Tenant-Name: tempest-VolumesGetTestJSON-513904272 Aug 27 02:26:31.990063 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User: tempest-VolumesGetTestJSON-513904272-project Aug 27 02:26:31.990063 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User-Domain-Id: default Aug 27 02:26:31.990063 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User-Domain-Name: Default Aug 27 02:26:31.990063 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User-Id: 193f615602b14f15b2fb561f09ca2d37 Aug 27 02:26:31.990063 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User-Name: tempest-VolumesGetTestJSON-513904272-project Aug 27 02:26:31.990063 dv-cinder-846303-3-smb devstack@n-api.service[120783]: method: Aug 27 02:26:31.990063 dv-cinder-846303-3-smb devstack@n-api.service[120783]: exception: Volume f45f1538-2900-4bdc-a49a-1341ce072cd0 could not be found. Aug 27 02:26:31.990063 dv-cinder-846303-3-smb devstack@n-api.service[120783]: action_args: {'id': 'f45f1538-2900-4bdc-a49a-1341ce072cd0'} Aug 27 02:26:31.990063 dv-cinder-846303-3-smb devstack@n-api.service[120783]: {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:26:31.991021 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:26:31.991021 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 02:26:31.991021 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 02:26:31.991021 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 27 02:26:31.991021 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 27 02:26:31.991021 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 27 02:26:31.991021 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 27 02:26:31.991021 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 27 02:26:31.991021 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 27 02:26:31.991021 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 27 02:26:31.991021 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 27 02:26:31.991021 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 02:26:31.991021 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 02:26:31.991021 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 02:26:31.991021 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 02:26:31.991021 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f45f1538-2900-4bdc-a49a-1341ce072cd0 could not be found. (HTTP 404) (Request-ID: req-e6400903-7164-4869-9775-3f9045bb653b) Aug 27 02:26:31.991021 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:26:31.991021 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:26:31.991021 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:26:31.992210 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:26:31.992210 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 27 02:26:31.992210 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 27 02:26:31.992210 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 27 02:26:31.992210 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 27 02:26:31.992210 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 27 02:26:31.992210 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 27 02:26:31.992210 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 27 02:26:31.992210 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 27 02:26:31.992210 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 02:26:31.992210 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 02:26:31.992210 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 27 02:26:31.992210 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 27 02:26:31.992210 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 27 02:26:31.992210 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 27 02:26:31.992210 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 27 02:26:31.992210 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 27 02:26:31.992210 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 27 02:26:31.992210 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 27 02:26:31.993379 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 02:26:31.993379 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 02:26:31.993379 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 02:26:31.993379 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 02:26:31.993379 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f45f1538-2900-4bdc-a49a-1341ce072cd0 could not be found. Aug 27 02:26:31.993379 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:26:31.993379 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:26:31.993379 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:26:31.993379 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:26:31.993379 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:26:31.993379 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:26:31.993379 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:26:31.993379 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:26:31.993379 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:26:31.993379 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:26:31.993379 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:26:31.993379 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:26:31.993379 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 27 02:26:31.993379 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:26:31.995144 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f45f1538-2900-4bdc-a49a-1341ce072cd0 could not be found. Aug 27 02:26:31.995144 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:26:31.995144 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:26:31.995144 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:26:31.995144 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:26:31.995144 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:26:31.995144 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:26:31.995144 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:26:31.995144 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:26:31.995144 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f45f1538-2900-4bdc-a49a-1341ce072cd0 could not be found. Aug 27 02:26:31.995144 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:26:31.995144 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-50e3ff49-27f2-4148-9288-aa64eb33b7c6 tempest-VolumesGetTestJSON-513904272 tempest-VolumesGetTestJSON-513904272-project] Returning 404 to user: Volume f45f1538-2900-4bdc-a49a-1341ce072cd0 could not be found. {{(pid=120783) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:26:31.995144 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-50e3ff49-27f2-4148-9288-aa64eb33b7c6 tempest-VolumesGetTestJSON-513904272 tempest-VolumesGetTestJSON-513904272-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/f45f1538-2900-4bdc-a49a-1341ce072cd0" status: 404 len: 109 microversion: 2.1 time: 0.040655 Aug 27 02:26:31.995144 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 412/841] 10.222.0.61 () {58 vars in 1245 bytes} [Sat Aug 27 02:26:31 2022] GET /compute/v2.1/os-volumes/f45f1538-2900-4bdc-a49a-1341ce072cd0 => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:26:32.421114 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-154549bf-143b-4bf3-939a-f87d82b089f8 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:26:32.421707 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-154549bf-143b-4bf3-939a-f87d82b089f8 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 99f2f366-4776-427e-99cf-79399835f2c8] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:26:32.436825 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-154549bf-143b-4bf3-939a-f87d82b089f8 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:32.439363 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-154549bf-143b-4bf3-939a-f87d82b089f8 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:32.443004 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-154549bf-143b-4bf3-939a-f87d82b089f8 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:32.445286 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-154549bf-143b-4bf3-939a-f87d82b089f8 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:32.445848 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-154549bf-143b-4bf3-939a-f87d82b089f8 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:32.446796 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-154549bf-143b-4bf3-939a-f87d82b089f8 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:32.478333 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [req-d88704c9-b810-41a9-bc8a-0321c123cf4b req-156eb0e5-b26e-4e78-a4d6-0f7b2e6a4a67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8", "name": "network-vif-deleted", "tag": "d60d4774-8401-4c3b-b403-1555799f9a3f"}]} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:26:32.479742 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.objects.instance [None req-154549bf-143b-4bf3-939a-f87d82b089f8 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lazy-loading 'flavor' on Instance uuid 99f2f366-4776-427e-99cf-79399835f2c8 {{(pid=120782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:26:32.489197 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-d88704c9-b810-41a9-bc8a-0321c123cf4b req-156eb0e5-b26e-4e78-a4d6-0f7b2e6a4a67 service nova] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:32.489696 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-d88704c9-b810-41a9-bc8a-0321c123cf4b req-156eb0e5-b26e-4e78-a4d6-0f7b2e6a4a67 service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:32.490117 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-d88704c9-b810-41a9-bc8a-0321c123cf4b req-156eb0e5-b26e-4e78-a4d6-0f7b2e6a4a67 service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:32.502031 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.compute.server_external_events [req-d88704c9-b810-41a9-bc8a-0321c123cf4b req-156eb0e5-b26e-4e78-a4d6-0f7b2e6a4a67 service nova] Creating event network-vif-deleted:d60d4774-8401-4c3b-b403-1555799f9a3f for instance 49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8 on hv-cinder-84630 Aug 27 02:26:32.518148 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [req-d88704c9-b810-41a9-bc8a-0321c123cf4b req-156eb0e5-b26e-4e78-a4d6-0f7b2e6a4a67 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043597 Aug 27 02:26:32.518875 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 413/842] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Aug 27 02:26:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:26:32.688884 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-59d4aa43-5dd1-48e7-a179-4dc4f8fada93 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:26:32.689950 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-59d4aa43-5dd1-48e7-a179-4dc4f8fada93 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] [instance: 49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:26:32.702568 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-59d4aa43-5dd1-48e7-a179-4dc4f8fada93 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:32.703072 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-59d4aa43-5dd1-48e7-a179-4dc4f8fada93 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:32.703499 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-59d4aa43-5dd1-48e7-a179-4dc4f8fada93 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:32.706216 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-59d4aa43-5dd1-48e7-a179-4dc4f8fada93 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:32.708483 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-59d4aa43-5dd1-48e7-a179-4dc4f8fada93 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:32.708860 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-59d4aa43-5dd1-48e7-a179-4dc4f8fada93 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:32.764023 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-154549bf-143b-4bf3-939a-f87d82b089f8 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "POST /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8/action" status: 202 len: 0 microversion: 2.20 time: 0.347114 Aug 27 02:26:32.766166 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 430/843] 10.222.0.61 () {62 vars in 1319 bytes} [Sat Aug 27 02:26:32 2022] POST /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8/action => generated 0 bytes in 350 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:26:32.771682 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-59d4aa43-5dd1-48e7-a179-4dc4f8fada93 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:32.772387 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-59d4aa43-5dd1-48e7-a179-4dc4f8fada93 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:32.772997 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-59d4aa43-5dd1-48e7-a179-4dc4f8fada93 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:32.773638 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.objects.instance [None req-59d4aa43-5dd1-48e7-a179-4dc4f8fada93 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lazy-loading 'fault' on Instance uuid 49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8 {{(pid=120783) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:26:32.775674 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-47d43a10-b1a1-488e-a091-75355299d4e7 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:26:32.776370 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-47d43a10-b1a1-488e-a091-75355299d4e7 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 99f2f366-4776-427e-99cf-79399835f2c8] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:26:32.784091 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-47d43a10-b1a1-488e-a091-75355299d4e7 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:32.784753 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-47d43a10-b1a1-488e-a091-75355299d4e7 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:32.785544 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-47d43a10-b1a1-488e-a091-75355299d4e7 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:32.786630 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-47d43a10-b1a1-488e-a091-75355299d4e7 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:32.790799 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-47d43a10-b1a1-488e-a091-75355299d4e7 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:32.791566 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-47d43a10-b1a1-488e-a091-75355299d4e7 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:32.832943 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-59d4aa43-5dd1-48e7-a179-4dc4f8fada93 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931dcabba0214e3daa878f31cd1706cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f956d4d27437c830871f6634a3018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:32.862319 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-59d4aa43-5dd1-48e7-a179-4dc4f8fada93 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] 10.222.0.61 "GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8" status: 200 len: 1348 microversion: 2.1 time: 0.177551 Aug 27 02:26:32.863336 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 414/844] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:26:32 2022] GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8 => generated 1348 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:26:32.983657 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-47d43a10-b1a1-488e-a091-75355299d4e7 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:32.993045 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-47d43a10-b1a1-488e-a091-75355299d4e7 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:32.994452 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-47d43a10-b1a1-488e-a091-75355299d4e7 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:32.995609 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-47d43a10-b1a1-488e-a091-75355299d4e7 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8" status: 200 len: 1722 microversion: 2.20 time: 0.224865 Aug 27 02:26:32.996178 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 431/845] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:26:32 2022] GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8 => generated 1722 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:26:33.884195 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-50d23640-d1da-494c-ad29-27df44d364b1 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:26:33.884908 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-50d23640-d1da-494c-ad29-27df44d364b1 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] [instance: 49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:26:33.892279 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-50d23640-d1da-494c-ad29-27df44d364b1 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:33.893025 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-50d23640-d1da-494c-ad29-27df44d364b1 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:33.893630 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-50d23640-d1da-494c-ad29-27df44d364b1 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:33.894443 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-50d23640-d1da-494c-ad29-27df44d364b1 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:33.895151 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-50d23640-d1da-494c-ad29-27df44d364b1 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:33.895642 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-50d23640-d1da-494c-ad29-27df44d364b1 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:33.911133 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.wsgi [None req-50d23640-d1da-494c-ad29-27df44d364b1 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] HTTP exception thrown: Instance 49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8 could not be found. Aug 27 02:26:33.912784 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-50d23640-d1da-494c-ad29-27df44d364b1 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Request method failure captured: Aug 27 02:26:33.912784 dv-cinder-846303-3-smb devstack@n-api.service[120783]: request: GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8 HTTP/1.1 Aug 27 02:26:33.912784 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Accept: application/json Aug 27 02:26:33.912784 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Accept-Encoding: identity Aug 27 02:26:33.912784 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Connection: close Aug 27 02:26:33.912784 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Content-Length: 0 Aug 27 02:26:33.912784 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Content-Type: application/json Aug 27 02:26:33.912784 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Host: 10.222.0.61 Aug 27 02:26:33.912784 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Openstack-System-Scope: None Aug 27 02:26:33.912784 dv-cinder-846303-3-smb devstack@n-api.service[120783]: User-Agent: python-urllib3/1.26.11 Aug 27 02:26:33.912784 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Auth-Token: gAAAAABjCX__DPIuDv91nBIIAvPY_xgZFXgRji7HXckBVWMKkwW7fQ1ns9VxjvDKnac6X4G2Z9rkWKuBHRivbp6HS_7_RVJESt03MFh7J-gKuk9ntTJvMnT6rBUg8N1QT8PDuiBQmS_c-XMxGaKLZJGHBF_GV0m2NQtUYAoyNJ8polKveF_foIs Aug 27 02:26:33.912784 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Domain-Id: None Aug 27 02:26:33.912784 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Domain-Name: None Aug 27 02:26:33.912784 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Identity-Status: Confirmed Aug 27 02:26:33.912784 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Is-Admin-Project: True Aug 27 02:26:33.912784 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Project-Domain-Id: default Aug 27 02:26:33.912784 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Project-Domain-Name: Default Aug 27 02:26:33.912784 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Project-Id: fe4f956d4d27437c830871f6634a3018 Aug 27 02:26:33.912784 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Project-Name: tempest-TestMinimumBasicScenario-50349326 Aug 27 02:26:33.912784 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Role: member,reader Aug 27 02:26:33.912784 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Roles: member,reader Aug 27 02:26:33.914283 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/fe4f956d4d27437c830871f6634a3018"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_fe4f956d4d27437c830871f6634a3018", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fe4f956d4d27437c830871f6634a3018"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fe4f956d4d27437c830871f6634a3018"}]}] Aug 27 02:26:33.914283 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Tenant: tempest-TestMinimumBasicScenario-50349326 Aug 27 02:26:33.914283 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Tenant-Id: fe4f956d4d27437c830871f6634a3018 Aug 27 02:26:33.914283 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Tenant-Name: tempest-TestMinimumBasicScenario-50349326 Aug 27 02:26:33.914283 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User: tempest-TestMinimumBasicScenario-50349326-project Aug 27 02:26:33.914283 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User-Domain-Id: default Aug 27 02:26:33.914283 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User-Domain-Name: Default Aug 27 02:26:33.914283 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User-Id: 931dcabba0214e3daa878f31cd1706cc Aug 27 02:26:33.914283 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User-Name: tempest-TestMinimumBasicScenario-50349326-project Aug 27 02:26:33.914283 dv-cinder-846303-3-smb devstack@n-api.service[120783]: method: > Aug 27 02:26:33.914283 dv-cinder-846303-3-smb devstack@n-api.service[120783]: exception: Instance 49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8 could not be found. Aug 27 02:26:33.914283 dv-cinder-846303-3-smb devstack@n-api.service[120783]: action_args: {'id': '49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8'} Aug 27 02:26:33.915132 dv-cinder-846303-3-smb devstack@n-api.service[120783]: {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:26:33.915132 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:26:33.915132 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:26:33.915132 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:26:33.915132 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:26:33.915132 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:26:33.915132 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:26:33.915132 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:26:33.915132 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:26:33.915132 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:26:33.915132 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8 could not be found. Aug 27 02:26:33.915132 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:26:33.915132 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:26:33.915132 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:26:33.915132 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:26:33.915132 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:26:33.915132 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:26:33.915132 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:26:33.915132 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:26:33.915132 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:26:33.916575 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:26:33.916575 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:26:33.916575 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:26:33.916575 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:26:33.916575 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:26:33.916575 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:26:33.916575 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:26:33.916575 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8 could not be found. Aug 27 02:26:33.916575 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:26:33.916575 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:26:33.916575 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:26:33.916575 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:26:33.916575 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:26:33.916575 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:26:33.916575 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:26:33.916575 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:26:33.916575 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8 could not be found. Aug 27 02:26:33.916575 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:26:33.917884 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-50d23640-d1da-494c-ad29-27df44d364b1 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Returning 404 to user: Instance 49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8 could not be found. {{(pid=120783) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:26:33.917884 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-50d23640-d1da-494c-ad29-27df44d364b1 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] 10.222.0.61 "GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8" status: 404 len: 111 microversion: 2.1 time: 0.034564 Aug 27 02:26:33.917884 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 415/846] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:26:33 2022] GET /compute/v2.1/servers/49b4efd2-9c3c-4e23-aa30-3c73fb9a58b8 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:26:33.923852 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-44cc2bb8-2042-4313-8aac-0b9706d48a85 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] Calling method '.version_select at 0x7fd80837f5e0>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:26:33.952102 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-44cc2bb8-2042-4313-8aac-0b9706d48a85 tempest-TestMinimumBasicScenario-50349326 tempest-TestMinimumBasicScenario-50349326-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1390106949" status: 202 len: 0 microversion: 2.1 time: 0.032150 Aug 27 02:26:33.952840 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 432/847] 10.222.0.61 () {58 vars in 1272 bytes} [Sat Aug 27 02:26:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1390106949 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:26:34.019427 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-6ea2823f-e05e-4145-acf3-c92e48597160 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:26:34.020230 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-6ea2823f-e05e-4145-acf3-c92e48597160 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 99f2f366-4776-427e-99cf-79399835f2c8] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:26:34.027387 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6ea2823f-e05e-4145-acf3-c92e48597160 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:34.028028 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6ea2823f-e05e-4145-acf3-c92e48597160 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:34.028746 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6ea2823f-e05e-4145-acf3-c92e48597160 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:34.029593 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6ea2823f-e05e-4145-acf3-c92e48597160 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:34.030162 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6ea2823f-e05e-4145-acf3-c92e48597160 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:34.030708 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6ea2823f-e05e-4145-acf3-c92e48597160 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:34.192630 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-6ea2823f-e05e-4145-acf3-c92e48597160 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:34.201337 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-6ea2823f-e05e-4145-acf3-c92e48597160 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:34.203878 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-6ea2823f-e05e-4145-acf3-c92e48597160 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:34.205267 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-6ea2823f-e05e-4145-acf3-c92e48597160 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8" status: 200 len: 1722 microversion: 2.20 time: 0.190462 Aug 27 02:26:34.212070 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 416/848] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:26:34 2022] GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8 => generated 1722 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:26:35.229425 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-5857573d-e7a5-422a-934f-b38b25236e1d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:26:35.230082 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-5857573d-e7a5-422a-934f-b38b25236e1d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 99f2f366-4776-427e-99cf-79399835f2c8] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:26:35.236853 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5857573d-e7a5-422a-934f-b38b25236e1d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:35.237603 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5857573d-e7a5-422a-934f-b38b25236e1d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:35.237804 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5857573d-e7a5-422a-934f-b38b25236e1d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:35.238557 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5857573d-e7a5-422a-934f-b38b25236e1d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:35.239004 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5857573d-e7a5-422a-934f-b38b25236e1d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:35.239452 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5857573d-e7a5-422a-934f-b38b25236e1d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:35.244864 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:26:35.575707 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-5857573d-e7a5-422a-934f-b38b25236e1d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:35.584598 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-5857573d-e7a5-422a-934f-b38b25236e1d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:35.586063 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-5857573d-e7a5-422a-934f-b38b25236e1d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:35.587218 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-5857573d-e7a5-422a-934f-b38b25236e1d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8" status: 200 len: 1722 microversion: 2.20 time: 0.362812 Aug 27 02:26:35.587779 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 433/849] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:26:35 2022] GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8 => generated 1722 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:26:36.610788 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-afada968-1c80-4646-b0f2-27f5f024718d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:26:36.611549 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-afada968-1c80-4646-b0f2-27f5f024718d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 99f2f366-4776-427e-99cf-79399835f2c8] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:26:36.619168 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-afada968-1c80-4646-b0f2-27f5f024718d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:36.619664 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-afada968-1c80-4646-b0f2-27f5f024718d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:36.620104 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-afada968-1c80-4646-b0f2-27f5f024718d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:36.620814 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-afada968-1c80-4646-b0f2-27f5f024718d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:36.621264 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-afada968-1c80-4646-b0f2-27f5f024718d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:36.622011 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-afada968-1c80-4646-b0f2-27f5f024718d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:37.181924 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-afada968-1c80-4646-b0f2-27f5f024718d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:37.196758 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-afada968-1c80-4646-b0f2-27f5f024718d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:37.200480 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-afada968-1c80-4646-b0f2-27f5f024718d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:37.201740 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-afada968-1c80-4646-b0f2-27f5f024718d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8" status: 200 len: 1722 microversion: 2.20 time: 0.595048 Aug 27 02:26:37.202818 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 417/850] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:26:36 2022] GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8 => generated 1722 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:26:38.227410 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-4e5e5763-889a-4b3d-af43-50faa47d7d4d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:26:38.228005 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-4e5e5763-889a-4b3d-af43-50faa47d7d4d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 99f2f366-4776-427e-99cf-79399835f2c8] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:26:38.235804 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4e5e5763-889a-4b3d-af43-50faa47d7d4d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:38.236295 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4e5e5763-889a-4b3d-af43-50faa47d7d4d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:38.236965 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4e5e5763-889a-4b3d-af43-50faa47d7d4d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:38.237955 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4e5e5763-889a-4b3d-af43-50faa47d7d4d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:38.238408 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4e5e5763-889a-4b3d-af43-50faa47d7d4d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:38.238826 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4e5e5763-889a-4b3d-af43-50faa47d7d4d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:38.400860 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-4e5e5763-889a-4b3d-af43-50faa47d7d4d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:38.421711 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-4e5e5763-889a-4b3d-af43-50faa47d7d4d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:38.421711 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-4e5e5763-889a-4b3d-af43-50faa47d7d4d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:38.421711 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-4e5e5763-889a-4b3d-af43-50faa47d7d4d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8" status: 200 len: 1722 microversion: 2.20 time: 0.194788 Aug 27 02:26:38.421990 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 434/851] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:26:38 2022] GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8 => generated 1722 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:26:39.440793 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-c6c281b2-6713-44b8-93f3-2760fe502d7b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:26:39.441546 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-c6c281b2-6713-44b8-93f3-2760fe502d7b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 99f2f366-4776-427e-99cf-79399835f2c8] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:26:39.449347 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c6c281b2-6713-44b8-93f3-2760fe502d7b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:39.449866 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c6c281b2-6713-44b8-93f3-2760fe502d7b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:39.450289 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c6c281b2-6713-44b8-93f3-2760fe502d7b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:39.451276 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c6c281b2-6713-44b8-93f3-2760fe502d7b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:39.451776 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c6c281b2-6713-44b8-93f3-2760fe502d7b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:39.452389 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c6c281b2-6713-44b8-93f3-2760fe502d7b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:39.583456 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-c6c281b2-6713-44b8-93f3-2760fe502d7b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:39.592204 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-c6c281b2-6713-44b8-93f3-2760fe502d7b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:39.593782 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-c6c281b2-6713-44b8-93f3-2760fe502d7b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:39.595020 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-c6c281b2-6713-44b8-93f3-2760fe502d7b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8" status: 200 len: 1722 microversion: 2.20 time: 0.158238 Aug 27 02:26:39.595764 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 418/852] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:26:39 2022] GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:26:40.620275 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-aa34a1d8-08f3-4ebe-abe1-503a15c03475 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:26:40.621512 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-aa34a1d8-08f3-4ebe-abe1-503a15c03475 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 99f2f366-4776-427e-99cf-79399835f2c8] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:26:40.630262 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-aa34a1d8-08f3-4ebe-abe1-503a15c03475 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:40.631119 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-aa34a1d8-08f3-4ebe-abe1-503a15c03475 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:40.631897 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-aa34a1d8-08f3-4ebe-abe1-503a15c03475 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:40.632914 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-aa34a1d8-08f3-4ebe-abe1-503a15c03475 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:40.633707 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-aa34a1d8-08f3-4ebe-abe1-503a15c03475 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:40.635054 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-aa34a1d8-08f3-4ebe-abe1-503a15c03475 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:40.972480 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-aa34a1d8-08f3-4ebe-abe1-503a15c03475 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:40.988343 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-aa34a1d8-08f3-4ebe-abe1-503a15c03475 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:40.990241 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-aa34a1d8-08f3-4ebe-abe1-503a15c03475 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:40.991765 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-aa34a1d8-08f3-4ebe-abe1-503a15c03475 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8" status: 200 len: 1722 microversion: 2.20 time: 0.376691 Aug 27 02:26:41.006724 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 435/853] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:26:40 2022] GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8 => generated 1722 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:26:42.017591 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-2d9928d2-d607-4bff-903e-bce16bcd7bef tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:26:42.018159 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-2d9928d2-d607-4bff-903e-bce16bcd7bef tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 99f2f366-4776-427e-99cf-79399835f2c8] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:26:42.027343 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2d9928d2-d607-4bff-903e-bce16bcd7bef tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:42.029341 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2d9928d2-d607-4bff-903e-bce16bcd7bef tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:42.029850 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2d9928d2-d607-4bff-903e-bce16bcd7bef tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:42.034875 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2d9928d2-d607-4bff-903e-bce16bcd7bef tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:42.035417 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2d9928d2-d607-4bff-903e-bce16bcd7bef tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:42.035852 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2d9928d2-d607-4bff-903e-bce16bcd7bef tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:42.350996 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-2d9928d2-d607-4bff-903e-bce16bcd7bef tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:42.367293 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-2d9928d2-d607-4bff-903e-bce16bcd7bef tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:42.368905 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-2d9928d2-d607-4bff-903e-bce16bcd7bef tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:42.370124 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-2d9928d2-d607-4bff-903e-bce16bcd7bef tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8" status: 200 len: 1722 microversion: 2.20 time: 0.357537 Aug 27 02:26:42.370882 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 419/854] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:26:42 2022] GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8 => generated 1722 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:26:43.394731 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-834368c9-8059-41e1-a843-d10ad20e2d58 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:26:43.395350 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-834368c9-8059-41e1-a843-d10ad20e2d58 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 99f2f366-4776-427e-99cf-79399835f2c8] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:26:43.401768 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-834368c9-8059-41e1-a843-d10ad20e2d58 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:43.402257 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-834368c9-8059-41e1-a843-d10ad20e2d58 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:43.402692 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-834368c9-8059-41e1-a843-d10ad20e2d58 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:43.403605 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-834368c9-8059-41e1-a843-d10ad20e2d58 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:43.404309 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-834368c9-8059-41e1-a843-d10ad20e2d58 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:43.404972 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-834368c9-8059-41e1-a843-d10ad20e2d58 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:43.556944 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-834368c9-8059-41e1-a843-d10ad20e2d58 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:43.566576 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-834368c9-8059-41e1-a843-d10ad20e2d58 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:43.568244 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-834368c9-8059-41e1-a843-d10ad20e2d58 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:43.569506 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-834368c9-8059-41e1-a843-d10ad20e2d58 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8" status: 200 len: 1722 microversion: 2.20 time: 0.178722 Aug 27 02:26:43.570056 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 436/855] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:26:43 2022] GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8 => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:26:44.596233 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-c5b0d159-dcad-4394-a637-400c1abf6222 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:26:44.597252 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-c5b0d159-dcad-4394-a637-400c1abf6222 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 99f2f366-4776-427e-99cf-79399835f2c8] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:26:44.605348 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c5b0d159-dcad-4394-a637-400c1abf6222 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:44.605863 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c5b0d159-dcad-4394-a637-400c1abf6222 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:44.606556 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c5b0d159-dcad-4394-a637-400c1abf6222 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:44.607269 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c5b0d159-dcad-4394-a637-400c1abf6222 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:44.607780 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c5b0d159-dcad-4394-a637-400c1abf6222 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:44.608188 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c5b0d159-dcad-4394-a637-400c1abf6222 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:44.786335 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-c5b0d159-dcad-4394-a637-400c1abf6222 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:44.795173 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-c5b0d159-dcad-4394-a637-400c1abf6222 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:44.796703 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-c5b0d159-dcad-4394-a637-400c1abf6222 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:44.798180 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-c5b0d159-dcad-4394-a637-400c1abf6222 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8" status: 200 len: 1722 microversion: 2.20 time: 0.208013 Aug 27 02:26:44.798816 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 420/856] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:26:44 2022] GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8 => generated 1722 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:26:45.822988 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-48e71aa2-8eb1-471c-a752-fe24f771a435 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:26:45.823665 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-48e71aa2-8eb1-471c-a752-fe24f771a435 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 99f2f366-4776-427e-99cf-79399835f2c8] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:26:45.836071 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-48e71aa2-8eb1-471c-a752-fe24f771a435 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:45.836572 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-48e71aa2-8eb1-471c-a752-fe24f771a435 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:45.836997 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-48e71aa2-8eb1-471c-a752-fe24f771a435 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:45.837775 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-48e71aa2-8eb1-471c-a752-fe24f771a435 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:45.838191 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-48e71aa2-8eb1-471c-a752-fe24f771a435 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:45.838630 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-48e71aa2-8eb1-471c-a752-fe24f771a435 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:46.037411 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-48e71aa2-8eb1-471c-a752-fe24f771a435 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:46.055121 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-48e71aa2-8eb1-471c-a752-fe24f771a435 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:46.057900 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-48e71aa2-8eb1-471c-a752-fe24f771a435 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:46.059772 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-48e71aa2-8eb1-471c-a752-fe24f771a435 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8" status: 200 len: 1722 microversion: 2.20 time: 0.241036 Aug 27 02:26:46.060368 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 437/857] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:26:45 2022] GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8 => generated 1722 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:26:47.085822 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-1282fce8-427b-434e-9f6f-4ed956adb587 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:26:47.086442 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-1282fce8-427b-434e-9f6f-4ed956adb587 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 99f2f366-4776-427e-99cf-79399835f2c8] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:26:47.089125 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_api:SELECT=44 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:26:47.094575 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1282fce8-427b-434e-9f6f-4ed956adb587 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:47.095061 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1282fce8-427b-434e-9f6f-4ed956adb587 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:47.095495 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1282fce8-427b-434e-9f6f-4ed956adb587 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:47.096289 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1282fce8-427b-434e-9f6f-4ed956adb587 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:47.096851 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1282fce8-427b-434e-9f6f-4ed956adb587 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:47.097366 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1282fce8-427b-434e-9f6f-4ed956adb587 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:47.250212 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-1282fce8-427b-434e-9f6f-4ed956adb587 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:47.259683 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-1282fce8-427b-434e-9f6f-4ed956adb587 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:47.261105 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-1282fce8-427b-434e-9f6f-4ed956adb587 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:47.262401 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-1282fce8-427b-434e-9f6f-4ed956adb587 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8" status: 200 len: 1722 microversion: 2.20 time: 0.180971 Aug 27 02:26:47.262954 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 421/858] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:26:47 2022] GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8 => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:26:48.286385 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-08acd911-7653-415b-adff-3e9c79c530cb tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:26:48.286996 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-08acd911-7653-415b-adff-3e9c79c530cb tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 99f2f366-4776-427e-99cf-79399835f2c8] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:26:48.289658 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:26:48.296457 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-08acd911-7653-415b-adff-3e9c79c530cb tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:48.296982 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-08acd911-7653-415b-adff-3e9c79c530cb tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:48.297386 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-08acd911-7653-415b-adff-3e9c79c530cb tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:48.298162 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-08acd911-7653-415b-adff-3e9c79c530cb tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:48.298619 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-08acd911-7653-415b-adff-3e9c79c530cb tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:48.299036 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-08acd911-7653-415b-adff-3e9c79c530cb tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:48.445318 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-08acd911-7653-415b-adff-3e9c79c530cb tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:48.454272 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-08acd911-7653-415b-adff-3e9c79c530cb tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:48.455949 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-08acd911-7653-415b-adff-3e9c79c530cb tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:48.457180 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-08acd911-7653-415b-adff-3e9c79c530cb tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8" status: 200 len: 1722 microversion: 2.20 time: 0.174845 Aug 27 02:26:48.457803 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 438/859] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:26:48 2022] GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:26:49.482757 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-3d96eefa-0ca1-4318-a971-dc70c554b29d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:26:49.483997 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-3d96eefa-0ca1-4318-a971-dc70c554b29d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 99f2f366-4776-427e-99cf-79399835f2c8] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:26:49.493610 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3d96eefa-0ca1-4318-a971-dc70c554b29d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:49.494529 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3d96eefa-0ca1-4318-a971-dc70c554b29d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:49.495684 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3d96eefa-0ca1-4318-a971-dc70c554b29d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:49.496600 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3d96eefa-0ca1-4318-a971-dc70c554b29d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:49.497564 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3d96eefa-0ca1-4318-a971-dc70c554b29d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:49.498418 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3d96eefa-0ca1-4318-a971-dc70c554b29d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:49.521889 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:26:49.670066 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-3d96eefa-0ca1-4318-a971-dc70c554b29d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:49.679908 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-3d96eefa-0ca1-4318-a971-dc70c554b29d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:49.681376 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-3d96eefa-0ca1-4318-a971-dc70c554b29d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:49.682854 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-3d96eefa-0ca1-4318-a971-dc70c554b29d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8" status: 200 len: 1722 microversion: 2.20 time: 0.205815 Aug 27 02:26:49.683513 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 422/860] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:26:49 2022] GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8 => generated 1722 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:26:50.712155 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-6d235664-6eec-4c97-b0e5-eb4473a5bf1f tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:26:50.712949 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-6d235664-6eec-4c97-b0e5-eb4473a5bf1f tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 99f2f366-4776-427e-99cf-79399835f2c8] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:26:50.721145 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6d235664-6eec-4c97-b0e5-eb4473a5bf1f tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:50.721773 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6d235664-6eec-4c97-b0e5-eb4473a5bf1f tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:50.722240 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6d235664-6eec-4c97-b0e5-eb4473a5bf1f tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:50.723035 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6d235664-6eec-4c97-b0e5-eb4473a5bf1f tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:50.723695 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6d235664-6eec-4c97-b0e5-eb4473a5bf1f tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:50.724120 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6d235664-6eec-4c97-b0e5-eb4473a5bf1f tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:50.909077 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-6d235664-6eec-4c97-b0e5-eb4473a5bf1f tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:50.918181 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-6d235664-6eec-4c97-b0e5-eb4473a5bf1f tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:50.920228 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-6d235664-6eec-4c97-b0e5-eb4473a5bf1f tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:50.921817 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-6d235664-6eec-4c97-b0e5-eb4473a5bf1f tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8" status: 200 len: 1722 microversion: 2.20 time: 0.214489 Aug 27 02:26:50.922397 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 439/861] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:26:50 2022] GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8 => generated 1722 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:26:51.952802 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-833043c0-e8b5-4570-b2a7-c393cebc9fe0 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:26:51.953716 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-833043c0-e8b5-4570-b2a7-c393cebc9fe0 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 99f2f366-4776-427e-99cf-79399835f2c8] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:26:51.960394 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-833043c0-e8b5-4570-b2a7-c393cebc9fe0 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:51.960886 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-833043c0-e8b5-4570-b2a7-c393cebc9fe0 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:51.961308 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-833043c0-e8b5-4570-b2a7-c393cebc9fe0 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:51.962057 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-833043c0-e8b5-4570-b2a7-c393cebc9fe0 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:51.962511 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-833043c0-e8b5-4570-b2a7-c393cebc9fe0 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:51.962931 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-833043c0-e8b5-4570-b2a7-c393cebc9fe0 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:52.115601 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-833043c0-e8b5-4570-b2a7-c393cebc9fe0 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:52.124589 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-833043c0-e8b5-4570-b2a7-c393cebc9fe0 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:52.126158 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-833043c0-e8b5-4570-b2a7-c393cebc9fe0 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:52.127641 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-833043c0-e8b5-4570-b2a7-c393cebc9fe0 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8" status: 200 len: 1722 microversion: 2.20 time: 0.179169 Aug 27 02:26:52.128253 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 423/862] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:26:51 2022] GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8 => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:26:52.872741 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-86fe4815-0b43-4a1e-a31e-6aaf14ae1ef0 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:26:52.873310 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-86fe4815-0b43-4a1e-a31e-6aaf14ae1ef0 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] [instance: 9fb59350-4f09-4e20-bddb-ffc9a65897b3] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:26:52.880339 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-86fe4815-0b43-4a1e-a31e-6aaf14ae1ef0 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:52.880830 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-86fe4815-0b43-4a1e-a31e-6aaf14ae1ef0 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:52.881254 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-86fe4815-0b43-4a1e-a31e-6aaf14ae1ef0 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:52.881991 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-86fe4815-0b43-4a1e-a31e-6aaf14ae1ef0 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:52.882450 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-86fe4815-0b43-4a1e-a31e-6aaf14ae1ef0 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:52.882872 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-86fe4815-0b43-4a1e-a31e-6aaf14ae1ef0 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:52.909936 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.objects.instance [None req-86fe4815-0b43-4a1e-a31e-6aaf14ae1ef0 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lazy-loading 'flavor' on Instance uuid 9fb59350-4f09-4e20-bddb-ffc9a65897b3 {{(pid=120782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:26:52.988085 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-86fe4815-0b43-4a1e-a31e-6aaf14ae1ef0 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] 10.222.0.61 "POST /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3/action" status: 202 len: 0 microversion: 2.1 time: 0.119292 Aug 27 02:26:52.988730 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 440/863] 10.222.0.61 () {60 vars in 1278 bytes} [Sat Aug 27 02:26:52 2022] POST /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:26:53.001143 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-27e07830-0428-4fe2-9f62-48d05ead883b tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:26:53.002345 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-27e07830-0428-4fe2-9f62-48d05ead883b tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] [instance: 9fb59350-4f09-4e20-bddb-ffc9a65897b3] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:26:53.011269 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-27e07830-0428-4fe2-9f62-48d05ead883b tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:53.011766 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-27e07830-0428-4fe2-9f62-48d05ead883b tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:53.012214 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-27e07830-0428-4fe2-9f62-48d05ead883b tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:53.013106 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-27e07830-0428-4fe2-9f62-48d05ead883b tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:53.013614 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-27e07830-0428-4fe2-9f62-48d05ead883b tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:53.014072 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-27e07830-0428-4fe2-9f62-48d05ead883b tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:53.151940 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-d53a0dee-62de-4a14-824f-a76f5c116e6b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:26:53.152571 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-d53a0dee-62de-4a14-824f-a76f5c116e6b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 99f2f366-4776-427e-99cf-79399835f2c8] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:26:53.160435 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d53a0dee-62de-4a14-824f-a76f5c116e6b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:53.161243 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d53a0dee-62de-4a14-824f-a76f5c116e6b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:53.162044 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d53a0dee-62de-4a14-824f-a76f5c116e6b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:53.162858 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d53a0dee-62de-4a14-824f-a76f5c116e6b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:53.163291 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d53a0dee-62de-4a14-824f-a76f5c116e6b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:53.163745 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d53a0dee-62de-4a14-824f-a76f5c116e6b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:53.171467 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-27e07830-0428-4fe2-9f62-48d05ead883b tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f53d57f3544e5a25e1beeddab9af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2d4ae1c228446eb5bfc64d44348fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:53.179818 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-27e07830-0428-4fe2-9f62-48d05ead883b tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] 10.222.0.61 "GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3" status: 200 len: 1570 microversion: 2.1 time: 0.186237 Aug 27 02:26:53.180405 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 424/864] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:26:52 2022] GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3 => generated 1570 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:26:53.303560 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-d53a0dee-62de-4a14-824f-a76f5c116e6b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:53.315068 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-d53a0dee-62de-4a14-824f-a76f5c116e6b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:53.316764 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-d53a0dee-62de-4a14-824f-a76f5c116e6b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:53.318013 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-d53a0dee-62de-4a14-824f-a76f5c116e6b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8" status: 200 len: 1722 microversion: 2.20 time: 0.170581 Aug 27 02:26:53.318591 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 441/865] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:26:53 2022] GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:26:53.443106 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-f9a5dfb9-5883-4257-9f00-100682ba6a3a tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:26:53.443597 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-f9a5dfb9-5883-4257-9f00-100682ba6a3a tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 9cad910f-6edf-4462-9db0-4e7f0a060620] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:26:53.449974 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f9a5dfb9-5883-4257-9f00-100682ba6a3a tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:53.450465 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f9a5dfb9-5883-4257-9f00-100682ba6a3a tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:53.450907 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f9a5dfb9-5883-4257-9f00-100682ba6a3a tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:53.451617 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f9a5dfb9-5883-4257-9f00-100682ba6a3a tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:53.452071 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f9a5dfb9-5883-4257-9f00-100682ba6a3a tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:53.452488 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f9a5dfb9-5883-4257-9f00-100682ba6a3a tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:53.477110 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-f9a5dfb9-5883-4257-9f00-100682ba6a3a tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "GET /compute/v2.1/servers/9cad910f-6edf-4462-9db0-4e7f0a060620/ips" status: 200 len: 145 microversion: 2.1 time: 0.224782 Aug 27 02:26:53.477938 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 425/866] 10.222.0.61 () {58 vars in 1248 bytes} [Sat Aug 27 02:26:53 2022] GET /compute/v2.1/servers/9cad910f-6edf-4462-9db0-4e7f0a060620/ips => generated 145 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:26:54.202681 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-36ffcd57-7fde-40f5-a025-2a1084578a85 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:26:54.203260 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-36ffcd57-7fde-40f5-a025-2a1084578a85 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] [instance: 9fb59350-4f09-4e20-bddb-ffc9a65897b3] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:26:54.210279 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-36ffcd57-7fde-40f5-a025-2a1084578a85 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:54.210768 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-36ffcd57-7fde-40f5-a025-2a1084578a85 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:54.211197 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-36ffcd57-7fde-40f5-a025-2a1084578a85 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:54.211928 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-36ffcd57-7fde-40f5-a025-2a1084578a85 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:54.212348 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-36ffcd57-7fde-40f5-a025-2a1084578a85 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:54.212761 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-36ffcd57-7fde-40f5-a025-2a1084578a85 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:54.342145 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-da63e037-6e02-49e2-9952-c2c6c6b21798 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:26:54.342748 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-da63e037-6e02-49e2-9952-c2c6c6b21798 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 99f2f366-4776-427e-99cf-79399835f2c8] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:26:54.349671 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-da63e037-6e02-49e2-9952-c2c6c6b21798 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:54.350160 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-da63e037-6e02-49e2-9952-c2c6c6b21798 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:54.350586 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-da63e037-6e02-49e2-9952-c2c6c6b21798 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:54.351285 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-da63e037-6e02-49e2-9952-c2c6c6b21798 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:54.351734 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-da63e037-6e02-49e2-9952-c2c6c6b21798 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:54.352140 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-da63e037-6e02-49e2-9952-c2c6c6b21798 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:54.357783 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-36ffcd57-7fde-40f5-a025-2a1084578a85 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f53d57f3544e5a25e1beeddab9af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2d4ae1c228446eb5bfc64d44348fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:54.365875 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-36ffcd57-7fde-40f5-a025-2a1084578a85 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] 10.222.0.61 "GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3" status: 200 len: 1570 microversion: 2.1 time: 0.166965 Aug 27 02:26:54.366592 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 442/867] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:26:54 2022] GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3 => generated 1570 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:26:54.483504 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-da63e037-6e02-49e2-9952-c2c6c6b21798 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:54.492599 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-da63e037-6e02-49e2-9952-c2c6c6b21798 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:54.494075 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-da63e037-6e02-49e2-9952-c2c6c6b21798 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:54.495236 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-da63e037-6e02-49e2-9952-c2c6c6b21798 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8" status: 200 len: 1743 microversion: 2.20 time: 0.157248 Aug 27 02:26:54.495833 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 426/868] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:26:54 2022] GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8 => generated 1743 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:26:54.854650 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-fd2064f5-17d0-4dda-ad88-410d4c51ddea tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b06e8f43-286d-40f3-bf73-40987d4c86db"}} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:26:54.857106 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-fd2064f5-17d0-4dda-ad88-410d4c51ddea tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 9cad910f-6edf-4462-9db0-4e7f0a060620] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:26:54.864062 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fd2064f5-17d0-4dda-ad88-410d4c51ddea tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:54.864552 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fd2064f5-17d0-4dda-ad88-410d4c51ddea tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:54.864986 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fd2064f5-17d0-4dda-ad88-410d4c51ddea tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:54.865771 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fd2064f5-17d0-4dda-ad88-410d4c51ddea tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:54.866222 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fd2064f5-17d0-4dda-ad88-410d4c51ddea tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:54.866649 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fd2064f5-17d0-4dda-ad88-410d4c51ddea tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:55.174180 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-fd2064f5-17d0-4dda-ad88-410d4c51ddea tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "POST /compute/v2.1/servers/9cad910f-6edf-4462-9db0-4e7f0a060620/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.323356 Aug 27 02:26:55.174804 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 443/869] 10.222.0.61 () {60 vars in 1323 bytes} [Sat Aug 27 02:26:54 2022] POST /compute/v2.1/servers/9cad910f-6edf-4462-9db0-4e7f0a060620/os-volume_attachments => generated 194 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:26:55.387200 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-5bba9491-f729-45a8-bdd8-3cd1ed223f0b tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:26:55.388680 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-5bba9491-f729-45a8-bdd8-3cd1ed223f0b tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] [instance: 9fb59350-4f09-4e20-bddb-ffc9a65897b3] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:26:55.396061 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5bba9491-f729-45a8-bdd8-3cd1ed223f0b tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:55.396854 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5bba9491-f729-45a8-bdd8-3cd1ed223f0b tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:55.397361 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5bba9491-f729-45a8-bdd8-3cd1ed223f0b tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:55.398171 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5bba9491-f729-45a8-bdd8-3cd1ed223f0b tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:55.398757 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5bba9491-f729-45a8-bdd8-3cd1ed223f0b tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:55.399243 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5bba9491-f729-45a8-bdd8-3cd1ed223f0b tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:55.520487 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-f5dc29e9-8b96-498b-8e2a-a1d2c0ea18a2 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:26:55.521219 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-f5dc29e9-8b96-498b-8e2a-a1d2c0ea18a2 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 99f2f366-4776-427e-99cf-79399835f2c8] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:26:55.528041 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f5dc29e9-8b96-498b-8e2a-a1d2c0ea18a2 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:55.528297 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f5dc29e9-8b96-498b-8e2a-a1d2c0ea18a2 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:55.528577 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f5dc29e9-8b96-498b-8e2a-a1d2c0ea18a2 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:55.529278 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f5dc29e9-8b96-498b-8e2a-a1d2c0ea18a2 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:55.529754 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f5dc29e9-8b96-498b-8e2a-a1d2c0ea18a2 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:55.530204 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f5dc29e9-8b96-498b-8e2a-a1d2c0ea18a2 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:55.543600 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-5bba9491-f729-45a8-bdd8-3cd1ed223f0b tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f53d57f3544e5a25e1beeddab9af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2d4ae1c228446eb5bfc64d44348fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:55.551939 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-5bba9491-f729-45a8-bdd8-3cd1ed223f0b tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] 10.222.0.61 "GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3" status: 200 len: 1570 microversion: 2.1 time: 0.169279 Aug 27 02:26:55.552996 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 427/870] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:26:55 2022] GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3 => generated 1570 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:26:55.701547 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-f5dc29e9-8b96-498b-8e2a-a1d2c0ea18a2 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:55.711352 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-f5dc29e9-8b96-498b-8e2a-a1d2c0ea18a2 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:55.713385 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-f5dc29e9-8b96-498b-8e2a-a1d2c0ea18a2 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:55.715463 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-f5dc29e9-8b96-498b-8e2a-a1d2c0ea18a2 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8" status: 200 len: 1743 microversion: 2.20 time: 0.199936 Aug 27 02:26:55.716518 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 444/871] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:26:55 2022] GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8 => generated 1743 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:26:56.577357 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-6ddc6457-12e3-44de-8e18-c80e3eeda1b7 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:26:56.578165 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-6ddc6457-12e3-44de-8e18-c80e3eeda1b7 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] [instance: 9fb59350-4f09-4e20-bddb-ffc9a65897b3] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:26:56.586240 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6ddc6457-12e3-44de-8e18-c80e3eeda1b7 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:56.586820 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6ddc6457-12e3-44de-8e18-c80e3eeda1b7 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:56.587257 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6ddc6457-12e3-44de-8e18-c80e3eeda1b7 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:56.588047 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6ddc6457-12e3-44de-8e18-c80e3eeda1b7 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:56.588529 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6ddc6457-12e3-44de-8e18-c80e3eeda1b7 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:56.589005 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6ddc6457-12e3-44de-8e18-c80e3eeda1b7 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:56.739795 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-67f09517-0195-4857-8b25-150b385a301e tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:26:56.740181 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-67f09517-0195-4857-8b25-150b385a301e tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 99f2f366-4776-427e-99cf-79399835f2c8] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:26:56.746779 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-67f09517-0195-4857-8b25-150b385a301e tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:56.747246 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-67f09517-0195-4857-8b25-150b385a301e tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:56.750361 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-67f09517-0195-4857-8b25-150b385a301e tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:56.751860 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-67f09517-0195-4857-8b25-150b385a301e tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:56.752719 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-67f09517-0195-4857-8b25-150b385a301e tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:56.753914 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-67f09517-0195-4857-8b25-150b385a301e tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:56.763430 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-6ddc6457-12e3-44de-8e18-c80e3eeda1b7 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f53d57f3544e5a25e1beeddab9af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2d4ae1c228446eb5bfc64d44348fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:56.773802 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-6ddc6457-12e3-44de-8e18-c80e3eeda1b7 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] 10.222.0.61 "GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3" status: 200 len: 1570 microversion: 2.1 time: 0.200945 Aug 27 02:26:56.774876 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 428/872] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:26:56 2022] GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3 => generated 1570 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:26:56.931926 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-67f09517-0195-4857-8b25-150b385a301e tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:56.943137 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-67f09517-0195-4857-8b25-150b385a301e tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:56.944789 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-67f09517-0195-4857-8b25-150b385a301e tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:56.946277 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-67f09517-0195-4857-8b25-150b385a301e tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8" status: 200 len: 1738 microversion: 2.20 time: 0.211170 Aug 27 02:26:56.946956 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 445/873] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:26:56 2022] GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8 => generated 1738 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:26:57.475218 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-08566ac1-a215-48d7-b234-728127544459 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:26:57.494128 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-08566ac1-a215-48d7-b234-728127544459 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 9cad910f-6edf-4462-9db0-4e7f0a060620] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:26:57.513565 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-08566ac1-a215-48d7-b234-728127544459 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:57.516682 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-08566ac1-a215-48d7-b234-728127544459 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:57.517314 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-08566ac1-a215-48d7-b234-728127544459 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:57.519020 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-08566ac1-a215-48d7-b234-728127544459 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:57.519502 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-08566ac1-a215-48d7-b234-728127544459 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:57.519936 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-08566ac1-a215-48d7-b234-728127544459 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:57.563588 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:26:57.593247 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-08566ac1-a215-48d7-b234-728127544459 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "GET /compute/v2.1/servers/9cad910f-6edf-4462-9db0-4e7f0a060620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.122519 Aug 27 02:26:57.594448 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 446/874] 10.222.0.61 () {58 vars in 1302 bytes} [Sat Aug 27 02:26:57 2022] GET /compute/v2.1/servers/9cad910f-6edf-4462-9db0-4e7f0a060620/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:26:57.605027 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-2066c604-17a7-41e6-8efd-34a9ca742949 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:26:57.605786 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-2066c604-17a7-41e6-8efd-34a9ca742949 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 9cad910f-6edf-4462-9db0-4e7f0a060620] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:26:57.606232 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [req-d78afd93-ed09-4db8-94e4-c37f559de016 req-138effd7-8fae-4974-ba57-44f23c63ef63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99f2f366-4776-427e-99cf-79399835f2c8", "name": "network-vif-plugged", "status": "completed", "tag": "dc94d858-1637-4028-b898-2687b284cae7"}]} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:26:57.617908 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-d78afd93-ed09-4db8-94e4-c37f559de016 req-138effd7-8fae-4974-ba57-44f23c63ef63 service nova] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:57.618878 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-d78afd93-ed09-4db8-94e4-c37f559de016 req-138effd7-8fae-4974-ba57-44f23c63ef63 service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:57.619388 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-d78afd93-ed09-4db8-94e4-c37f559de016 req-138effd7-8fae-4974-ba57-44f23c63ef63 service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:57.620229 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2066c604-17a7-41e6-8efd-34a9ca742949 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:57.620963 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2066c604-17a7-41e6-8efd-34a9ca742949 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:57.621628 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2066c604-17a7-41e6-8efd-34a9ca742949 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:57.622663 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2066c604-17a7-41e6-8efd-34a9ca742949 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:57.623316 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2066c604-17a7-41e6-8efd-34a9ca742949 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:57.624039 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2066c604-17a7-41e6-8efd-34a9ca742949 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:57.639205 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.compute.server_external_events [req-d78afd93-ed09-4db8-94e4-c37f559de016 req-138effd7-8fae-4974-ba57-44f23c63ef63 service nova] Creating event network-vif-plugged:dc94d858-1637-4028-b898-2687b284cae7 for instance 99f2f366-4776-427e-99cf-79399835f2c8 on hv-cinder-84630 Aug 27 02:26:57.647932 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [req-d78afd93-ed09-4db8-94e4-c37f559de016 req-138effd7-8fae-4974-ba57-44f23c63ef63 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.175729 Aug 27 02:26:57.649176 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 429/875] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Aug 27 02:26:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:26:57.685233 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-2066c604-17a7-41e6-8efd-34a9ca742949 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "GET /compute/v2.1/servers/9cad910f-6edf-4462-9db0-4e7f0a060620/os-volume_attachments/b06e8f43-286d-40f3-bf73-40987d4c86db" status: 200 len: 194 microversion: 2.1 time: 0.081858 Aug 27 02:26:57.686877 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 447/876] 10.222.0.61 () {58 vars in 1413 bytes} [Sat Aug 27 02:26:57 2022] GET /compute/v2.1/servers/9cad910f-6edf-4462-9db0-4e7f0a060620/os-volume_attachments/b06e8f43-286d-40f3-bf73-40987d4c86db => generated 194 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:26:57.811036 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-fefa3c28-84d6-4d48-be95-3557c62a171a tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:26:57.815000 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-fefa3c28-84d6-4d48-be95-3557c62a171a tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] [instance: 9fb59350-4f09-4e20-bddb-ffc9a65897b3] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:26:57.839573 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fefa3c28-84d6-4d48-be95-3557c62a171a tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:57.840069 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fefa3c28-84d6-4d48-be95-3557c62a171a tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:57.840498 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fefa3c28-84d6-4d48-be95-3557c62a171a tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:57.844742 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fefa3c28-84d6-4d48-be95-3557c62a171a tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:57.848750 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fefa3c28-84d6-4d48-be95-3557c62a171a tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:57.854621 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fefa3c28-84d6-4d48-be95-3557c62a171a tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:57.989757 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-f1c41bfd-0edf-4124-92b1-b8e78441e737 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:26:57.990390 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-f1c41bfd-0edf-4124-92b1-b8e78441e737 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 99f2f366-4776-427e-99cf-79399835f2c8] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:26:58.003506 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f1c41bfd-0edf-4124-92b1-b8e78441e737 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:58.014206 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f1c41bfd-0edf-4124-92b1-b8e78441e737 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:58.015256 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f1c41bfd-0edf-4124-92b1-b8e78441e737 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:58.016151 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f1c41bfd-0edf-4124-92b1-b8e78441e737 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:58.016771 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f1c41bfd-0edf-4124-92b1-b8e78441e737 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:58.023102 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f1c41bfd-0edf-4124-92b1-b8e78441e737 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:58.126835 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-fefa3c28-84d6-4d48-be95-3557c62a171a tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f53d57f3544e5a25e1beeddab9af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2d4ae1c228446eb5bfc64d44348fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:58.143170 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-fefa3c28-84d6-4d48-be95-3557c62a171a tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] 10.222.0.61 "GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3" status: 200 len: 1570 microversion: 2.1 time: 0.351698 Aug 27 02:26:58.149705 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 430/877] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:26:57 2022] GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3 => generated 1570 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:26:58.311923 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-f1c41bfd-0edf-4124-92b1-b8e78441e737 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:58.323511 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-f1c41bfd-0edf-4124-92b1-b8e78441e737 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:58.324960 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-f1c41bfd-0edf-4124-92b1-b8e78441e737 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:58.326195 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-f1c41bfd-0edf-4124-92b1-b8e78441e737 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8" status: 200 len: 1738 microversion: 2.20 time: 0.358980 Aug 27 02:26:58.326722 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 448/878] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:26:57 2022] GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8 => generated 1738 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:26:59.177539 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-e427a29f-a99d-4630-ad7e-8b3871268b7d tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:26:59.186484 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-e427a29f-a99d-4630-ad7e-8b3871268b7d tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] [instance: 9fb59350-4f09-4e20-bddb-ffc9a65897b3] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:26:59.208550 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e427a29f-a99d-4630-ad7e-8b3871268b7d tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:59.209708 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e427a29f-a99d-4630-ad7e-8b3871268b7d tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:59.213352 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e427a29f-a99d-4630-ad7e-8b3871268b7d tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:59.214252 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e427a29f-a99d-4630-ad7e-8b3871268b7d tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:59.214925 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e427a29f-a99d-4630-ad7e-8b3871268b7d tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:59.215661 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e427a29f-a99d-4630-ad7e-8b3871268b7d tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:59.295986 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-5e78693a-e4de-4d9d-a040-6a70395b6526 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7b7e97a2-e742-4ee1-acf9-308824c34112"}} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:26:59.311996 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-5e78693a-e4de-4d9d-a040-6a70395b6526 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 9cad910f-6edf-4462-9db0-4e7f0a060620] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:26:59.325296 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5e78693a-e4de-4d9d-a040-6a70395b6526 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:59.327372 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5e78693a-e4de-4d9d-a040-6a70395b6526 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:59.329806 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5e78693a-e4de-4d9d-a040-6a70395b6526 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:59.330606 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5e78693a-e4de-4d9d-a040-6a70395b6526 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:59.331192 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5e78693a-e4de-4d9d-a040-6a70395b6526 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:59.331694 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5e78693a-e4de-4d9d-a040-6a70395b6526 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:59.450350 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-e427a29f-a99d-4630-ad7e-8b3871268b7d tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f53d57f3544e5a25e1beeddab9af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2d4ae1c228446eb5bfc64d44348fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:59.461767 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-e427a29f-a99d-4630-ad7e-8b3871268b7d tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] 10.222.0.61 "GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3" status: 200 len: 1570 microversion: 2.1 time: 0.289497 Aug 27 02:26:59.462587 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 431/879] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:26:59 2022] GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3 => generated 1570 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:26:59.470183 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-563169d8-171e-4f62-92ac-1e4e11dd9349 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:26:59.474064 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-563169d8-171e-4f62-92ac-1e4e11dd9349 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 99f2f366-4776-427e-99cf-79399835f2c8] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:26:59.486275 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-563169d8-171e-4f62-92ac-1e4e11dd9349 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:59.487057 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-563169d8-171e-4f62-92ac-1e4e11dd9349 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:59.488013 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-563169d8-171e-4f62-92ac-1e4e11dd9349 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:59.489008 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-563169d8-171e-4f62-92ac-1e4e11dd9349 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:59.489836 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-563169d8-171e-4f62-92ac-1e4e11dd9349 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:59.490442 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-563169d8-171e-4f62-92ac-1e4e11dd9349 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:59.722954 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-563169d8-171e-4f62-92ac-1e4e11dd9349 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:59.734938 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-563169d8-171e-4f62-92ac-1e4e11dd9349 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:59.737251 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-563169d8-171e-4f62-92ac-1e4e11dd9349 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:59.739185 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-563169d8-171e-4f62-92ac-1e4e11dd9349 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8" status: 200 len: 1738 microversion: 2.20 time: 0.275226 Aug 27 02:26:59.740103 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 432/880] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:26:59 2022] GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8 => generated 1738 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:26:59.801293 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-5e78693a-e4de-4d9d-a040-6a70395b6526 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "POST /compute/v2.1/servers/9cad910f-6edf-4462-9db0-4e7f0a060620/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.513674 Aug 27 02:26:59.822176 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 449/881] 10.222.0.61 () {60 vars in 1323 bytes} [Sat Aug 27 02:26:59 2022] POST /compute/v2.1/servers/9cad910f-6edf-4462-9db0-4e7f0a060620/os-volume_attachments => generated 194 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:27:00.488256 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-579c613b-4feb-49d4-9a11-478b66227fdf tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:00.488850 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-579c613b-4feb-49d4-9a11-478b66227fdf tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] [instance: 9fb59350-4f09-4e20-bddb-ffc9a65897b3] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:00.496430 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-579c613b-4feb-49d4-9a11-478b66227fdf tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:00.497097 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-579c613b-4feb-49d4-9a11-478b66227fdf tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:00.497574 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-579c613b-4feb-49d4-9a11-478b66227fdf tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:00.500404 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-579c613b-4feb-49d4-9a11-478b66227fdf tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:00.500885 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-579c613b-4feb-49d4-9a11-478b66227fdf tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:00.501320 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-579c613b-4feb-49d4-9a11-478b66227fdf tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:00.692115 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-579c613b-4feb-49d4-9a11-478b66227fdf tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f53d57f3544e5a25e1beeddab9af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2d4ae1c228446eb5bfc64d44348fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:00.700770 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-579c613b-4feb-49d4-9a11-478b66227fdf tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] 10.222.0.61 "GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3" status: 200 len: 1570 microversion: 2.1 time: 0.216392 Aug 27 02:27:00.715939 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 433/882] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:00 2022] GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3 => generated 1570 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:00.767367 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-f0038b83-aa7a-44a4-8610-8829130da3c3 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:00.769501 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-f0038b83-aa7a-44a4-8610-8829130da3c3 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 99f2f366-4776-427e-99cf-79399835f2c8] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:00.778680 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f0038b83-aa7a-44a4-8610-8829130da3c3 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:00.779440 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f0038b83-aa7a-44a4-8610-8829130da3c3 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:00.780064 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f0038b83-aa7a-44a4-8610-8829130da3c3 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:00.781353 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f0038b83-aa7a-44a4-8610-8829130da3c3 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:00.782008 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f0038b83-aa7a-44a4-8610-8829130da3c3 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:00.782585 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f0038b83-aa7a-44a4-8610-8829130da3c3 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:00.966942 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-f0038b83-aa7a-44a4-8610-8829130da3c3 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:00.983836 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-f0038b83-aa7a-44a4-8610-8829130da3c3 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:00.985296 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-f0038b83-aa7a-44a4-8610-8829130da3c3 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:00.986626 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-f0038b83-aa7a-44a4-8610-8829130da3c3 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8" status: 200 len: 1738 microversion: 2.20 time: 0.227730 Aug 27 02:27:00.990397 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 450/883] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:27:00 2022] GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8 => generated 1738 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:27:01.724718 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-ddfb9a2a-0c2f-4eee-bae9-095e6177559f tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:01.727028 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-ddfb9a2a-0c2f-4eee-bae9-095e6177559f tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] [instance: 9fb59350-4f09-4e20-bddb-ffc9a65897b3] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:01.735503 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ddfb9a2a-0c2f-4eee-bae9-095e6177559f tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:01.736117 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ddfb9a2a-0c2f-4eee-bae9-095e6177559f tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:01.736619 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ddfb9a2a-0c2f-4eee-bae9-095e6177559f tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:01.737930 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ddfb9a2a-0c2f-4eee-bae9-095e6177559f tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:01.738617 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ddfb9a2a-0c2f-4eee-bae9-095e6177559f tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:01.739331 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ddfb9a2a-0c2f-4eee-bae9-095e6177559f tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:01.918055 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-ddfb9a2a-0c2f-4eee-bae9-095e6177559f tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f53d57f3544e5a25e1beeddab9af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2d4ae1c228446eb5bfc64d44348fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:01.924315 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-ddfb9a2a-0c2f-4eee-bae9-095e6177559f tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] 10.222.0.61 "GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3" status: 200 len: 1570 microversion: 2.1 time: 0.203714 Aug 27 02:27:01.924930 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 434/884] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:01 2022] GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3 => generated 1570 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:02.025118 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-ced95620-66a9-447b-b48d-7676d0303a36 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:02.027072 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-ced95620-66a9-447b-b48d-7676d0303a36 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 99f2f366-4776-427e-99cf-79399835f2c8] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:02.035221 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ced95620-66a9-447b-b48d-7676d0303a36 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:02.036027 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ced95620-66a9-447b-b48d-7676d0303a36 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:02.036677 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ced95620-66a9-447b-b48d-7676d0303a36 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:02.037664 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ced95620-66a9-447b-b48d-7676d0303a36 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:02.038446 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ced95620-66a9-447b-b48d-7676d0303a36 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:02.039161 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ced95620-66a9-447b-b48d-7676d0303a36 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:02.220494 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-6dda62ee-09b2-4ac7-b11b-6793b0f34734 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:02.224676 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-6dda62ee-09b2-4ac7-b11b-6793b0f34734 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 9cad910f-6edf-4462-9db0-4e7f0a060620] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:02.233221 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-ced95620-66a9-447b-b48d-7676d0303a36 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:02.236854 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6dda62ee-09b2-4ac7-b11b-6793b0f34734 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:02.237510 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6dda62ee-09b2-4ac7-b11b-6793b0f34734 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:02.238055 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6dda62ee-09b2-4ac7-b11b-6793b0f34734 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:02.242447 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6dda62ee-09b2-4ac7-b11b-6793b0f34734 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:02.243485 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6dda62ee-09b2-4ac7-b11b-6793b0f34734 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:02.244006 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6dda62ee-09b2-4ac7-b11b-6793b0f34734 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:02.244167 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-ced95620-66a9-447b-b48d-7676d0303a36 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:02.246569 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-ced95620-66a9-447b-b48d-7676d0303a36 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:02.248044 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-ced95620-66a9-447b-b48d-7676d0303a36 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8" status: 200 len: 1738 microversion: 2.20 time: 0.238422 Aug 27 02:27:02.257988 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 451/885] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:27:02 2022] GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8 => generated 1738 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:27:02.290550 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-6dda62ee-09b2-4ac7-b11b-6793b0f34734 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "GET /compute/v2.1/servers/9cad910f-6edf-4462-9db0-4e7f0a060620/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.075119 Aug 27 02:27:02.291434 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 435/886] 10.222.0.61 () {58 vars in 1302 bytes} [Sat Aug 27 02:27:02 2022] GET /compute/v2.1/servers/9cad910f-6edf-4462-9db0-4e7f0a060620/os-volume_attachments => generated 371 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:27:02.439600 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-507516b1-df1d-468d-821f-fcf7594579d7 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:02.440378 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-507516b1-df1d-468d-821f-fcf7594579d7 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 9cad910f-6edf-4462-9db0-4e7f0a060620] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:02.447122 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-507516b1-df1d-468d-821f-fcf7594579d7 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:02.447870 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-507516b1-df1d-468d-821f-fcf7594579d7 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:02.448529 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-507516b1-df1d-468d-821f-fcf7594579d7 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:02.449217 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-507516b1-df1d-468d-821f-fcf7594579d7 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:02.449851 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-507516b1-df1d-468d-821f-fcf7594579d7 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:02.450452 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-507516b1-df1d-468d-821f-fcf7594579d7 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:02.489370 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-507516b1-df1d-468d-821f-fcf7594579d7 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "GET /compute/v2.1/servers/9cad910f-6edf-4462-9db0-4e7f0a060620/os-volume_attachments/b06e8f43-286d-40f3-bf73-40987d4c86db" status: 200 len: 194 microversion: 2.1 time: 0.054105 Aug 27 02:27:02.490505 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 452/887] 10.222.0.61 () {58 vars in 1413 bytes} [Sat Aug 27 02:27:02 2022] GET /compute/v2.1/servers/9cad910f-6edf-4462-9db0-4e7f0a060620/os-volume_attachments/b06e8f43-286d-40f3-bf73-40987d4c86db => generated 194 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:27:02.505342 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-c09de226-744b-4b60-9b25-8b756218d32e tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:02.505912 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-c09de226-744b-4b60-9b25-8b756218d32e tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 9cad910f-6edf-4462-9db0-4e7f0a060620] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:02.512385 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c09de226-744b-4b60-9b25-8b756218d32e tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:02.512893 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c09de226-744b-4b60-9b25-8b756218d32e tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:02.513708 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c09de226-744b-4b60-9b25-8b756218d32e tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:02.515169 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c09de226-744b-4b60-9b25-8b756218d32e tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:02.515645 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c09de226-744b-4b60-9b25-8b756218d32e tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:02.516064 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c09de226-744b-4b60-9b25-8b756218d32e tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:02.638247 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.objects.instance [None req-c09de226-744b-4b60-9b25-8b756218d32e tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lazy-loading 'services' on Instance uuid 9cad910f-6edf-4462-9db0-4e7f0a060620 {{(pid=120783) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:27:02.732862 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-c09de226-744b-4b60-9b25-8b756218d32e tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "DELETE /compute/v2.1/servers/9cad910f-6edf-4462-9db0-4e7f0a060620/os-volume_attachments/b06e8f43-286d-40f3-bf73-40987d4c86db" status: 202 len: 0 microversion: 2.1 time: 0.235382 Aug 27 02:27:02.739506 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 436/888] 10.222.0.61 () {58 vars in 1416 bytes} [Sat Aug 27 02:27:02 2022] DELETE /compute/v2.1/servers/9cad910f-6edf-4462-9db0-4e7f0a060620/os-volume_attachments/b06e8f43-286d-40f3-bf73-40987d4c86db => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:27:02.946733 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-0217289e-f935-4293-873f-cdffe6b5325b tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:02.947378 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-0217289e-f935-4293-873f-cdffe6b5325b tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] [instance: 9fb59350-4f09-4e20-bddb-ffc9a65897b3] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:02.957837 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0217289e-f935-4293-873f-cdffe6b5325b tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:02.958425 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0217289e-f935-4293-873f-cdffe6b5325b tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:02.958935 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0217289e-f935-4293-873f-cdffe6b5325b tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:02.959719 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0217289e-f935-4293-873f-cdffe6b5325b tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:02.960325 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0217289e-f935-4293-873f-cdffe6b5325b tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:02.960825 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0217289e-f935-4293-873f-cdffe6b5325b tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:03.128694 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-0217289e-f935-4293-873f-cdffe6b5325b tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f53d57f3544e5a25e1beeddab9af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2d4ae1c228446eb5bfc64d44348fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:03.140161 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-0217289e-f935-4293-873f-cdffe6b5325b tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] 10.222.0.61 "GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3" status: 200 len: 1570 microversion: 2.1 time: 0.197458 Aug 27 02:27:03.140755 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 453/889] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:02 2022] GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3 => generated 1570 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:27:03.274422 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-9701a084-3d37-4710-8ee6-9a55f9254234 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:03.275244 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-9701a084-3d37-4710-8ee6-9a55f9254234 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 99f2f366-4776-427e-99cf-79399835f2c8] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:03.282565 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9701a084-3d37-4710-8ee6-9a55f9254234 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:03.282688 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9701a084-3d37-4710-8ee6-9a55f9254234 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:03.283104 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9701a084-3d37-4710-8ee6-9a55f9254234 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:03.283810 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9701a084-3d37-4710-8ee6-9a55f9254234 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:03.284261 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9701a084-3d37-4710-8ee6-9a55f9254234 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:03.284681 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9701a084-3d37-4710-8ee6-9a55f9254234 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:03.455264 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-9701a084-3d37-4710-8ee6-9a55f9254234 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:03.465360 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-9701a084-3d37-4710-8ee6-9a55f9254234 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:03.469155 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-9701a084-3d37-4710-8ee6-9a55f9254234 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:03.470970 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-9701a084-3d37-4710-8ee6-9a55f9254234 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8" status: 200 len: 1738 microversion: 2.20 time: 0.201880 Aug 27 02:27:03.493789 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 437/890] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:27:03 2022] GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8 => generated 1738 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:27:04.038864 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-caac3cbd-b823-490f-8252-363b878d7c27 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:04.039362 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-caac3cbd-b823-490f-8252-363b878d7c27 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: a279a105-ed85-45eb-9725-366e0cceb6d6] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:04.046578 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-caac3cbd-b823-490f-8252-363b878d7c27 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:04.047065 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-caac3cbd-b823-490f-8252-363b878d7c27 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:04.047498 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-caac3cbd-b823-490f-8252-363b878d7c27 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:04.048361 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-caac3cbd-b823-490f-8252-363b878d7c27 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:04.048655 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-caac3cbd-b823-490f-8252-363b878d7c27 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:04.049075 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-caac3cbd-b823-490f-8252-363b878d7c27 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:04.094728 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-caac3cbd-b823-490f-8252-363b878d7c27 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/a279a105-ed85-45eb-9725-366e0cceb6d6/ips" status: 200 len: 150 microversion: 2.1 time: 0.059718 Aug 27 02:27:04.096048 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 454/891] 10.222.0.61 () {58 vars in 1248 bytes} [Sat Aug 27 02:27:04 2022] GET /compute/v2.1/servers/a279a105-ed85-45eb-9725-366e0cceb6d6/ips => generated 150 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:27:04.162226 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-bc53911d-785a-4144-879f-9bc2eb3a2df5 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:04.162829 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-bc53911d-785a-4144-879f-9bc2eb3a2df5 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] [instance: 9fb59350-4f09-4e20-bddb-ffc9a65897b3] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:04.177255 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bc53911d-785a-4144-879f-9bc2eb3a2df5 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:04.182113 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bc53911d-785a-4144-879f-9bc2eb3a2df5 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:04.188686 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bc53911d-785a-4144-879f-9bc2eb3a2df5 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:04.189480 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bc53911d-785a-4144-879f-9bc2eb3a2df5 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:04.190102 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bc53911d-785a-4144-879f-9bc2eb3a2df5 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:04.190925 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bc53911d-785a-4144-879f-9bc2eb3a2df5 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:04.500184 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-bc53911d-785a-4144-879f-9bc2eb3a2df5 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f53d57f3544e5a25e1beeddab9af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2d4ae1c228446eb5bfc64d44348fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:04.501148 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-dcaf00eb-6373-45a1-bab6-55ce21d9f7ef tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:04.501822 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-dcaf00eb-6373-45a1-bab6-55ce21d9f7ef tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 99f2f366-4776-427e-99cf-79399835f2c8] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:04.515529 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-dcaf00eb-6373-45a1-bab6-55ce21d9f7ef tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:04.517334 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-bc53911d-785a-4144-879f-9bc2eb3a2df5 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] 10.222.0.61 "GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3" status: 200 len: 1570 microversion: 2.1 time: 0.358871 Aug 27 02:27:04.519396 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 438/892] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:04 2022] GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3 => generated 1570 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:04.531023 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-dcaf00eb-6373-45a1-bab6-55ce21d9f7ef tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:04.534748 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-dcaf00eb-6373-45a1-bab6-55ce21d9f7ef tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:04.536518 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-dcaf00eb-6373-45a1-bab6-55ce21d9f7ef tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:04.537296 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-dcaf00eb-6373-45a1-bab6-55ce21d9f7ef tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:04.538119 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-dcaf00eb-6373-45a1-bab6-55ce21d9f7ef tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:04.795619 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-dcaf00eb-6373-45a1-bab6-55ce21d9f7ef tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:04.804898 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-dcaf00eb-6373-45a1-bab6-55ce21d9f7ef tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:04.806500 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-dcaf00eb-6373-45a1-bab6-55ce21d9f7ef tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:04.808060 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-dcaf00eb-6373-45a1-bab6-55ce21d9f7ef tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8" status: 200 len: 1738 microversion: 2.20 time: 0.312833 Aug 27 02:27:04.808643 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 455/893] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:27:04 2022] GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8 => generated 1738 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:27:04.972647 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-26dfeb4a-67f1-4c4a-9141-da7452c74e5f tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:04.973770 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-26dfeb4a-67f1-4c4a-9141-da7452c74e5f tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 9cad910f-6edf-4462-9db0-4e7f0a060620] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:04.981991 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-26dfeb4a-67f1-4c4a-9141-da7452c74e5f tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:04.982867 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-26dfeb4a-67f1-4c4a-9141-da7452c74e5f tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:04.983453 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-26dfeb4a-67f1-4c4a-9141-da7452c74e5f tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:04.984342 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-26dfeb4a-67f1-4c4a-9141-da7452c74e5f tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:04.985226 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-26dfeb4a-67f1-4c4a-9141-da7452c74e5f tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:04.985811 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-26dfeb4a-67f1-4c4a-9141-da7452c74e5f tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:05.024440 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:27:05.040972 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-26dfeb4a-67f1-4c4a-9141-da7452c74e5f tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "GET /compute/v2.1/servers/9cad910f-6edf-4462-9db0-4e7f0a060620/os-volume_attachments/7b7e97a2-e742-4ee1-acf9-308824c34112" status: 200 len: 194 microversion: 2.1 time: 0.072819 Aug 27 02:27:05.042081 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 439/894] 10.222.0.61 () {58 vars in 1413 bytes} [Sat Aug 27 02:27:04 2022] GET /compute/v2.1/servers/9cad910f-6edf-4462-9db0-4e7f0a060620/os-volume_attachments/7b7e97a2-e742-4ee1-acf9-308824c34112 => generated 194 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:27:05.053231 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-bb4e2e6a-5e46-414a-b79b-19ae283d0ec1 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:05.053733 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-bb4e2e6a-5e46-414a-b79b-19ae283d0ec1 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 9cad910f-6edf-4462-9db0-4e7f0a060620] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:05.060556 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-bb4e2e6a-5e46-414a-b79b-19ae283d0ec1 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:05.061042 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-bb4e2e6a-5e46-414a-b79b-19ae283d0ec1 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:05.061538 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-bb4e2e6a-5e46-414a-b79b-19ae283d0ec1 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:05.062285 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-bb4e2e6a-5e46-414a-b79b-19ae283d0ec1 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:05.062736 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-bb4e2e6a-5e46-414a-b79b-19ae283d0ec1 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:05.063159 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-bb4e2e6a-5e46-414a-b79b-19ae283d0ec1 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:05.155021 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.objects.instance [None req-bb4e2e6a-5e46-414a-b79b-19ae283d0ec1 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lazy-loading 'services' on Instance uuid 9cad910f-6edf-4462-9db0-4e7f0a060620 {{(pid=120782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:27:05.247366 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-bb4e2e6a-5e46-414a-b79b-19ae283d0ec1 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "DELETE /compute/v2.1/servers/9cad910f-6edf-4462-9db0-4e7f0a060620/os-volume_attachments/7b7e97a2-e742-4ee1-acf9-308824c34112" status: 202 len: 0 microversion: 2.1 time: 0.198027 Aug 27 02:27:05.248057 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 456/895] 10.222.0.61 () {58 vars in 1416 bytes} [Sat Aug 27 02:27:05 2022] DELETE /compute/v2.1/servers/9cad910f-6edf-4462-9db0-4e7f0a060620/os-volume_attachments/7b7e97a2-e742-4ee1-acf9-308824c34112 => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:27:05.545224 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-7122f8d9-13f0-4995-a029-80d5e55c4cec tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:05.546834 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-7122f8d9-13f0-4995-a029-80d5e55c4cec tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] [instance: 9fb59350-4f09-4e20-bddb-ffc9a65897b3] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:05.554366 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7122f8d9-13f0-4995-a029-80d5e55c4cec tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:05.554855 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7122f8d9-13f0-4995-a029-80d5e55c4cec tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:05.555287 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7122f8d9-13f0-4995-a029-80d5e55c4cec tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:05.555993 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7122f8d9-13f0-4995-a029-80d5e55c4cec tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:05.556513 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7122f8d9-13f0-4995-a029-80d5e55c4cec tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:05.556937 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7122f8d9-13f0-4995-a029-80d5e55c4cec tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:05.713377 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-7122f8d9-13f0-4995-a029-80d5e55c4cec tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f53d57f3544e5a25e1beeddab9af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2d4ae1c228446eb5bfc64d44348fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:05.729709 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-cb941c4d-f50d-4dc3-b20e-0edbf3814787 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e58bfb65-b29e-4067-a0ef-d37b308dcb3f"}} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:27:05.731995 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-7122f8d9-13f0-4995-a029-80d5e55c4cec tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] 10.222.0.61 "GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3" status: 200 len: 1570 microversion: 2.1 time: 0.194058 Aug 27 02:27:05.732724 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 440/896] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:05 2022] GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3 => generated 1570 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:05.733154 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-cb941c4d-f50d-4dc3-b20e-0edbf3814787 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: a279a105-ed85-45eb-9725-366e0cceb6d6] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:05.743781 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cb941c4d-f50d-4dc3-b20e-0edbf3814787 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:05.744535 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cb941c4d-f50d-4dc3-b20e-0edbf3814787 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:05.745164 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cb941c4d-f50d-4dc3-b20e-0edbf3814787 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:05.746044 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cb941c4d-f50d-4dc3-b20e-0edbf3814787 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:05.746709 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cb941c4d-f50d-4dc3-b20e-0edbf3814787 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:05.747136 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cb941c4d-f50d-4dc3-b20e-0edbf3814787 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:05.831757 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-e2b9bb2f-7fb3-4810-b2f6-3803b5d11a82 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:05.834233 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-e2b9bb2f-7fb3-4810-b2f6-3803b5d11a82 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 99f2f366-4776-427e-99cf-79399835f2c8] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:05.844197 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e2b9bb2f-7fb3-4810-b2f6-3803b5d11a82 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:05.844698 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e2b9bb2f-7fb3-4810-b2f6-3803b5d11a82 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:05.845189 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e2b9bb2f-7fb3-4810-b2f6-3803b5d11a82 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:05.845976 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e2b9bb2f-7fb3-4810-b2f6-3803b5d11a82 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:05.846618 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e2b9bb2f-7fb3-4810-b2f6-3803b5d11a82 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:05.847426 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e2b9bb2f-7fb3-4810-b2f6-3803b5d11a82 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:06.003305 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-e2b9bb2f-7fb3-4810-b2f6-3803b5d11a82 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:06.016484 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-e2b9bb2f-7fb3-4810-b2f6-3803b5d11a82 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:06.018322 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-e2b9bb2f-7fb3-4810-b2f6-3803b5d11a82 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:06.019590 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-e2b9bb2f-7fb3-4810-b2f6-3803b5d11a82 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8" status: 200 len: 1738 microversion: 2.20 time: 0.192050 Aug 27 02:27:06.020197 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 441/897] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:27:05 2022] GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8 => generated 1738 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:27:06.480458 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-cb941c4d-f50d-4dc3-b20e-0edbf3814787 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "POST /compute/v2.1/servers/a279a105-ed85-45eb-9725-366e0cceb6d6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.755090 Aug 27 02:27:06.481263 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 457/898] 10.222.0.61 () {60 vars in 1323 bytes} [Sat Aug 27 02:27:05 2022] POST /compute/v2.1/servers/a279a105-ed85-45eb-9725-366e0cceb6d6/os-volume_attachments => generated 194 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:27:06.754476 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-9d2397d5-2912-45fc-99b2-334e25cc15bc tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:06.755151 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-9d2397d5-2912-45fc-99b2-334e25cc15bc tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] [instance: 9fb59350-4f09-4e20-bddb-ffc9a65897b3] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:06.762465 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9d2397d5-2912-45fc-99b2-334e25cc15bc tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:06.763112 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9d2397d5-2912-45fc-99b2-334e25cc15bc tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:06.766483 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9d2397d5-2912-45fc-99b2-334e25cc15bc tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:06.767545 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9d2397d5-2912-45fc-99b2-334e25cc15bc tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:06.768356 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9d2397d5-2912-45fc-99b2-334e25cc15bc tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:06.769023 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9d2397d5-2912-45fc-99b2-334e25cc15bc tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:06.969909 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-9d2397d5-2912-45fc-99b2-334e25cc15bc tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f53d57f3544e5a25e1beeddab9af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2d4ae1c228446eb5bfc64d44348fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:06.978076 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-9d2397d5-2912-45fc-99b2-334e25cc15bc tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] 10.222.0.61 "GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3" status: 200 len: 1570 microversion: 2.1 time: 0.227496 Aug 27 02:27:06.979976 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 442/899] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:06 2022] GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3 => generated 1570 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:07.045537 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-a0072342-7073-42c2-8457-baa41638ff67 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:07.047018 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-a0072342-7073-42c2-8457-baa41638ff67 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 99f2f366-4776-427e-99cf-79399835f2c8] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:07.056161 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a0072342-7073-42c2-8457-baa41638ff67 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:07.057026 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a0072342-7073-42c2-8457-baa41638ff67 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:07.057686 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a0072342-7073-42c2-8457-baa41638ff67 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:07.058714 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a0072342-7073-42c2-8457-baa41638ff67 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:07.059622 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a0072342-7073-42c2-8457-baa41638ff67 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:07.060813 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a0072342-7073-42c2-8457-baa41638ff67 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:07.246529 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-a0072342-7073-42c2-8457-baa41638ff67 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:07.272319 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-a0072342-7073-42c2-8457-baa41638ff67 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:07.275706 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-a0072342-7073-42c2-8457-baa41638ff67 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:07.278594 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-a0072342-7073-42c2-8457-baa41638ff67 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8" status: 200 len: 1738 microversion: 2.20 time: 0.238769 Aug 27 02:27:07.287320 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 458/900] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:27:07 2022] GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8 => generated 1738 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:27:07.510277 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-902cba15-6a89-4121-9a82-0394bcc5526f tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:07.512549 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-902cba15-6a89-4121-9a82-0394bcc5526f tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 9cad910f-6edf-4462-9db0-4e7f0a060620] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:07.518995 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-902cba15-6a89-4121-9a82-0394bcc5526f tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:07.519487 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-902cba15-6a89-4121-9a82-0394bcc5526f tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:07.519890 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-902cba15-6a89-4121-9a82-0394bcc5526f tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:07.520595 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-902cba15-6a89-4121-9a82-0394bcc5526f tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:07.521045 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-902cba15-6a89-4121-9a82-0394bcc5526f tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:07.521486 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-902cba15-6a89-4121-9a82-0394bcc5526f tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:07.559056 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-902cba15-6a89-4121-9a82-0394bcc5526f tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "GET /compute/v2.1/servers/9cad910f-6edf-4462-9db0-4e7f0a060620/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052672 Aug 27 02:27:07.560196 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 443/901] 10.222.0.61 () {58 vars in 1302 bytes} [Sat Aug 27 02:27:07 2022] GET /compute/v2.1/servers/9cad910f-6edf-4462-9db0-4e7f0a060620/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:27:07.716249 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-1b1d7162-68bb-40d6-a08e-2fe7442b740f tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:07.718648 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-1b1d7162-68bb-40d6-a08e-2fe7442b740f tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 9cad910f-6edf-4462-9db0-4e7f0a060620] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:07.726626 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1b1d7162-68bb-40d6-a08e-2fe7442b740f tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:07.727121 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1b1d7162-68bb-40d6-a08e-2fe7442b740f tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:07.727561 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1b1d7162-68bb-40d6-a08e-2fe7442b740f tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:07.728267 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1b1d7162-68bb-40d6-a08e-2fe7442b740f tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:07.728724 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1b1d7162-68bb-40d6-a08e-2fe7442b740f tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:07.729295 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1b1d7162-68bb-40d6-a08e-2fe7442b740f tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:07.760293 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-1b1d7162-68bb-40d6-a08e-2fe7442b740f tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "GET /compute/v2.1/servers/9cad910f-6edf-4462-9db0-4e7f0a060620/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048257 Aug 27 02:27:07.760867 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 459/902] 10.222.0.61 () {58 vars in 1302 bytes} [Sat Aug 27 02:27:07 2022] GET /compute/v2.1/servers/9cad910f-6edf-4462-9db0-4e7f0a060620/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:27:07.829243 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-19f7af74-480a-465e-bb02-e693ded3c11d tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:07.829920 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-19f7af74-480a-465e-bb02-e693ded3c11d tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 9cad910f-6edf-4462-9db0-4e7f0a060620] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:07.837357 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-19f7af74-480a-465e-bb02-e693ded3c11d tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:07.838023 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-19f7af74-480a-465e-bb02-e693ded3c11d tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:07.838544 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-19f7af74-480a-465e-bb02-e693ded3c11d tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:07.839251 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-19f7af74-480a-465e-bb02-e693ded3c11d tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:07.839717 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-19f7af74-480a-465e-bb02-e693ded3c11d tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:07.840134 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-19f7af74-480a-465e-bb02-e693ded3c11d tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:07.867418 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-19f7af74-480a-465e-bb02-e693ded3c11d tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 9cad910f-6edf-4462-9db0-4e7f0a060620] Going to try to terminate instance {{(pid=120783) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:27:07.954736 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-19f7af74-480a-465e-bb02-e693ded3c11d tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "DELETE /compute/v2.1/servers/9cad910f-6edf-4462-9db0-4e7f0a060620" status: 204 len: 0 microversion: 2.1 time: 0.129334 Aug 27 02:27:07.955323 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 444/903] 10.222.0.61 () {58 vars in 1239 bytes} [Sat Aug 27 02:27:07 2022] DELETE /compute/v2.1/servers/9cad910f-6edf-4462-9db0-4e7f0a060620 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:27:07.963854 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-f1ea835e-aafa-482f-a569-ee042de6a758 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:07.964464 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-f1ea835e-aafa-482f-a569-ee042de6a758 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 9cad910f-6edf-4462-9db0-4e7f0a060620] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:07.970834 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f1ea835e-aafa-482f-a569-ee042de6a758 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:07.971321 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f1ea835e-aafa-482f-a569-ee042de6a758 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:07.971876 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f1ea835e-aafa-482f-a569-ee042de6a758 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:07.972583 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f1ea835e-aafa-482f-a569-ee042de6a758 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:07.973033 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f1ea835e-aafa-482f-a569-ee042de6a758 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:07.973561 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f1ea835e-aafa-482f-a569-ee042de6a758 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:07.978430 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:27:08.001189 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-81acb1fd-8b58-4034-9857-0db5ec4e4485 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:08.002160 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-81acb1fd-8b58-4034-9857-0db5ec4e4485 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] [instance: 9fb59350-4f09-4e20-bddb-ffc9a65897b3] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:08.008729 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-81acb1fd-8b58-4034-9857-0db5ec4e4485 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:08.009218 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-81acb1fd-8b58-4034-9857-0db5ec4e4485 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:08.009677 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-81acb1fd-8b58-4034-9857-0db5ec4e4485 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:08.010398 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-81acb1fd-8b58-4034-9857-0db5ec4e4485 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:08.010832 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-81acb1fd-8b58-4034-9857-0db5ec4e4485 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:08.011252 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-81acb1fd-8b58-4034-9857-0db5ec4e4485 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:08.151401 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-f1ea835e-aafa-482f-a569-ee042de6a758 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fbea2c71674b239e6d8fba6518e962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d9d02db5c49fda33321f2914a7f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:08.164749 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-f1ea835e-aafa-482f-a569-ee042de6a758 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "GET /compute/v2.1/servers/9cad910f-6edf-4462-9db0-4e7f0a060620" status: 200 len: 1673 microversion: 2.1 time: 0.204736 Aug 27 02:27:08.165381 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 460/904] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:07 2022] GET /compute/v2.1/servers/9cad910f-6edf-4462-9db0-4e7f0a060620 => generated 1673 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:08.172860 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-81acb1fd-8b58-4034-9857-0db5ec4e4485 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f53d57f3544e5a25e1beeddab9af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2d4ae1c228446eb5bfc64d44348fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:08.180969 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-81acb1fd-8b58-4034-9857-0db5ec4e4485 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] 10.222.0.61 "GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3" status: 200 len: 1571 microversion: 2.1 time: 0.184289 Aug 27 02:27:08.181625 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 445/905] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:07 2022] GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3 => generated 1571 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:27:08.202073 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-1e9bc1a7-f6e6-4154-b465-2a6958b6ad60 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:27:08.202692 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-1e9bc1a7-f6e6-4154-b465-2a6958b6ad60 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] [instance: 9fb59350-4f09-4e20-bddb-ffc9a65897b3] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:08.208896 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1e9bc1a7-f6e6-4154-b465-2a6958b6ad60 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:08.209375 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1e9bc1a7-f6e6-4154-b465-2a6958b6ad60 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:08.209834 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1e9bc1a7-f6e6-4154-b465-2a6958b6ad60 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:08.210528 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1e9bc1a7-f6e6-4154-b465-2a6958b6ad60 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:08.210971 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1e9bc1a7-f6e6-4154-b465-2a6958b6ad60 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:08.211392 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1e9bc1a7-f6e6-4154-b465-2a6958b6ad60 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:08.303684 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-02166c64-11dd-4928-9067-dc409f4713d1 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:08.304585 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-02166c64-11dd-4928-9067-dc409f4713d1 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 99f2f366-4776-427e-99cf-79399835f2c8] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:08.311086 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-02166c64-11dd-4928-9067-dc409f4713d1 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:08.311862 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-02166c64-11dd-4928-9067-dc409f4713d1 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:08.312348 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-02166c64-11dd-4928-9067-dc409f4713d1 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:08.313124 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-02166c64-11dd-4928-9067-dc409f4713d1 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:08.313552 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-02166c64-11dd-4928-9067-dc409f4713d1 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:08.314137 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-02166c64-11dd-4928-9067-dc409f4713d1 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:08.375852 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-1e9bc1a7-f6e6-4154-b465-2a6958b6ad60 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] [instance: 9fb59350-4f09-4e20-bddb-ffc9a65897b3] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120782) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 27 02:27:08.455838 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-1e9bc1a7-f6e6-4154-b465-2a6958b6ad60 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] 10.222.0.61 "POST /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3/action" status: 202 len: 0 microversion: 2.1 time: 0.257545 Aug 27 02:27:08.456544 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 461/906] 10.222.0.61 () {60 vars in 1278 bytes} [Sat Aug 27 02:27:08 2022] POST /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3/action => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:27:08.465008 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-23dbaef9-42bd-4dfb-97ba-50a6766baeb1 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:08.465669 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-23dbaef9-42bd-4dfb-97ba-50a6766baeb1 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] [instance: 9fb59350-4f09-4e20-bddb-ffc9a65897b3] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:08.472146 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-23dbaef9-42bd-4dfb-97ba-50a6766baeb1 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:08.472637 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-23dbaef9-42bd-4dfb-97ba-50a6766baeb1 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:08.473069 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-23dbaef9-42bd-4dfb-97ba-50a6766baeb1 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:08.473811 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-23dbaef9-42bd-4dfb-97ba-50a6766baeb1 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:08.474276 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-23dbaef9-42bd-4dfb-97ba-50a6766baeb1 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:08.474756 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-23dbaef9-42bd-4dfb-97ba-50a6766baeb1 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:08.475097 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-02166c64-11dd-4928-9067-dc409f4713d1 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:08.485699 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-02166c64-11dd-4928-9067-dc409f4713d1 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:08.487730 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-02166c64-11dd-4928-9067-dc409f4713d1 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:08.489775 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-02166c64-11dd-4928-9067-dc409f4713d1 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8" status: 200 len: 1720 microversion: 2.20 time: 0.190240 Aug 27 02:27:08.490870 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 446/907] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:27:08 2022] GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8 => generated 1720 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:27:08.620985 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-23dbaef9-42bd-4dfb-97ba-50a6766baeb1 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f53d57f3544e5a25e1beeddab9af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2d4ae1c228446eb5bfc64d44348fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:08.629763 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-23dbaef9-42bd-4dfb-97ba-50a6766baeb1 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] 10.222.0.61 "GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3" status: 200 len: 1579 microversion: 2.1 time: 0.168703 Aug 27 02:27:08.630461 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 462/908] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:08 2022] GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3 => generated 1579 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:09.187687 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-8b7db5b6-2ac4-4d1d-a5b2-9a011e2f5ec1 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:09.188288 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-8b7db5b6-2ac4-4d1d-a5b2-9a011e2f5ec1 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 9cad910f-6edf-4462-9db0-4e7f0a060620] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:09.194982 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8b7db5b6-2ac4-4d1d-a5b2-9a011e2f5ec1 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:09.195466 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8b7db5b6-2ac4-4d1d-a5b2-9a011e2f5ec1 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:09.195896 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8b7db5b6-2ac4-4d1d-a5b2-9a011e2f5ec1 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:09.196591 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8b7db5b6-2ac4-4d1d-a5b2-9a011e2f5ec1 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:09.197042 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8b7db5b6-2ac4-4d1d-a5b2-9a011e2f5ec1 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:09.197487 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8b7db5b6-2ac4-4d1d-a5b2-9a011e2f5ec1 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:09.368839 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-8b7db5b6-2ac4-4d1d-a5b2-9a011e2f5ec1 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fbea2c71674b239e6d8fba6518e962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d9d02db5c49fda33321f2914a7f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:09.378209 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-8b7db5b6-2ac4-4d1d-a5b2-9a011e2f5ec1 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "GET /compute/v2.1/servers/9cad910f-6edf-4462-9db0-4e7f0a060620" status: 200 len: 1673 microversion: 2.1 time: 0.194298 Aug 27 02:27:09.378943 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 447/909] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:09 2022] GET /compute/v2.1/servers/9cad910f-6edf-4462-9db0-4e7f0a060620 => generated 1673 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:09.514171 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-30d67260-fb41-4c8c-bc4b-8af1b7ee0a25 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:09.515067 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-30d67260-fb41-4c8c-bc4b-8af1b7ee0a25 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 99f2f366-4776-427e-99cf-79399835f2c8] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:09.522042 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-30d67260-fb41-4c8c-bc4b-8af1b7ee0a25 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:09.522551 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-30d67260-fb41-4c8c-bc4b-8af1b7ee0a25 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:09.522991 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-30d67260-fb41-4c8c-bc4b-8af1b7ee0a25 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:09.523689 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-30d67260-fb41-4c8c-bc4b-8af1b7ee0a25 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:09.524152 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-30d67260-fb41-4c8c-bc4b-8af1b7ee0a25 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:09.524572 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-30d67260-fb41-4c8c-bc4b-8af1b7ee0a25 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:09.653666 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-0234abe2-925f-4727-ac44-44e8558dc43d tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:09.655332 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-0234abe2-925f-4727-ac44-44e8558dc43d tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] [instance: 9fb59350-4f09-4e20-bddb-ffc9a65897b3] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:09.665334 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0234abe2-925f-4727-ac44-44e8558dc43d tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:09.666112 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0234abe2-925f-4727-ac44-44e8558dc43d tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:09.666572 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0234abe2-925f-4727-ac44-44e8558dc43d tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:09.667596 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0234abe2-925f-4727-ac44-44e8558dc43d tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:09.668060 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0234abe2-925f-4727-ac44-44e8558dc43d tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:09.668477 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0234abe2-925f-4727-ac44-44e8558dc43d tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:09.679010 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-30d67260-fb41-4c8c-bc4b-8af1b7ee0a25 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:09.688757 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-30d67260-fb41-4c8c-bc4b-8af1b7ee0a25 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:09.690248 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-30d67260-fb41-4c8c-bc4b-8af1b7ee0a25 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:09.691925 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-30d67260-fb41-4c8c-bc4b-8af1b7ee0a25 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8" status: 200 len: 1720 microversion: 2.20 time: 0.181871 Aug 27 02:27:09.693029 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 463/910] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:27:09 2022] GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8 => generated 1720 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:27:09.843057 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-0234abe2-925f-4727-ac44-44e8558dc43d tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f53d57f3544e5a25e1beeddab9af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2d4ae1c228446eb5bfc64d44348fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:09.851121 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-0234abe2-925f-4727-ac44-44e8558dc43d tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] 10.222.0.61 "GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3" status: 200 len: 1579 microversion: 2.1 time: 0.203337 Aug 27 02:27:09.851702 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 448/911] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:09 2022] GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3 => generated 1579 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:10.400152 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-50e618c9-141d-4726-84c2-da93b9cce6b3 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:10.400780 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-50e618c9-141d-4726-84c2-da93b9cce6b3 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 9cad910f-6edf-4462-9db0-4e7f0a060620] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:10.407344 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-50e618c9-141d-4726-84c2-da93b9cce6b3 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:10.407834 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-50e618c9-141d-4726-84c2-da93b9cce6b3 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:10.408268 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-50e618c9-141d-4726-84c2-da93b9cce6b3 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:10.408983 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-50e618c9-141d-4726-84c2-da93b9cce6b3 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:10.409636 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-50e618c9-141d-4726-84c2-da93b9cce6b3 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:10.410056 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-50e618c9-141d-4726-84c2-da93b9cce6b3 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:10.585261 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-50e618c9-141d-4726-84c2-da93b9cce6b3 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fbea2c71674b239e6d8fba6518e962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d9d02db5c49fda33321f2914a7f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:10.599732 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-50e618c9-141d-4726-84c2-da93b9cce6b3 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "GET /compute/v2.1/servers/9cad910f-6edf-4462-9db0-4e7f0a060620" status: 200 len: 1673 microversion: 2.1 time: 0.203261 Aug 27 02:27:10.601367 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 464/912] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:10 2022] GET /compute/v2.1/servers/9cad910f-6edf-4462-9db0-4e7f0a060620 => generated 1673 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:10.717087 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-568d3af2-76d5-46ed-a878-a943c5199a5c tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:10.717864 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-568d3af2-76d5-46ed-a878-a943c5199a5c tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 99f2f366-4776-427e-99cf-79399835f2c8] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:10.730515 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-568d3af2-76d5-46ed-a878-a943c5199a5c tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:10.733881 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-568d3af2-76d5-46ed-a878-a943c5199a5c tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:10.735398 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-568d3af2-76d5-46ed-a878-a943c5199a5c tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:10.736446 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-568d3af2-76d5-46ed-a878-a943c5199a5c tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:10.737057 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-568d3af2-76d5-46ed-a878-a943c5199a5c tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:10.737821 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-568d3af2-76d5-46ed-a878-a943c5199a5c tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:10.882092 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-df34d73b-6896-473a-bdba-a98d41013d97 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:10.883483 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-df34d73b-6896-473a-bdba-a98d41013d97 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] [instance: 9fb59350-4f09-4e20-bddb-ffc9a65897b3] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:10.893057 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-df34d73b-6896-473a-bdba-a98d41013d97 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:10.894038 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-df34d73b-6896-473a-bdba-a98d41013d97 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:10.895288 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-df34d73b-6896-473a-bdba-a98d41013d97 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:10.897237 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-df34d73b-6896-473a-bdba-a98d41013d97 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:10.898515 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-df34d73b-6896-473a-bdba-a98d41013d97 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:10.899066 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-df34d73b-6896-473a-bdba-a98d41013d97 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:11.071012 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-df34d73b-6896-473a-bdba-a98d41013d97 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f53d57f3544e5a25e1beeddab9af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2d4ae1c228446eb5bfc64d44348fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:11.079821 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-df34d73b-6896-473a-bdba-a98d41013d97 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] 10.222.0.61 "GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3" status: 200 len: 1521 microversion: 2.1 time: 0.209506 Aug 27 02:27:11.080273 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 465/913] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:10 2022] GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3 => generated 1521 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:11.161126 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-ce05c113-728b-44d7-a2d2-3b8c72781646 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:11.161748 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-ce05c113-728b-44d7-a2d2-3b8c72781646 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: a279a105-ed85-45eb-9725-366e0cceb6d6] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:11.168214 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ce05c113-728b-44d7-a2d2-3b8c72781646 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:11.168733 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ce05c113-728b-44d7-a2d2-3b8c72781646 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:11.169166 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ce05c113-728b-44d7-a2d2-3b8c72781646 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:11.169958 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ce05c113-728b-44d7-a2d2-3b8c72781646 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:11.170415 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ce05c113-728b-44d7-a2d2-3b8c72781646 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:11.170832 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ce05c113-728b-44d7-a2d2-3b8c72781646 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:11.268533 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.objects.instance [None req-ce05c113-728b-44d7-a2d2-3b8c72781646 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lazy-loading 'services' on Instance uuid a279a105-ed85-45eb-9725-366e0cceb6d6 {{(pid=120782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:27:11.343938 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-568d3af2-76d5-46ed-a878-a943c5199a5c tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:11.362493 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-568d3af2-76d5-46ed-a878-a943c5199a5c tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:11.364005 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-568d3af2-76d5-46ed-a878-a943c5199a5c tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:11.365199 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-568d3af2-76d5-46ed-a878-a943c5199a5c tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8" status: 200 len: 1720 microversion: 2.20 time: 0.652800 Aug 27 02:27:11.365812 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 449/914] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:27:10 2022] GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8 => generated 1720 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:27:11.386999 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-ce05c113-728b-44d7-a2d2-3b8c72781646 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "DELETE /compute/v2.1/servers/a279a105-ed85-45eb-9725-366e0cceb6d6/os-volume_attachments/e58bfb65-b29e-4067-a0ef-d37b308dcb3f" status: 202 len: 0 microversion: 2.1 time: 0.229916 Aug 27 02:27:11.391980 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 466/915] 10.222.0.61 () {58 vars in 1416 bytes} [Sat Aug 27 02:27:11 2022] DELETE /compute/v2.1/servers/a279a105-ed85-45eb-9725-366e0cceb6d6/os-volume_attachments/e58bfb65-b29e-4067-a0ef-d37b308dcb3f => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:27:11.397005 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-6e42dbdf-a375-4e78-8428-89b38895e80e tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:11.399697 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-6e42dbdf-a375-4e78-8428-89b38895e80e tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: a279a105-ed85-45eb-9725-366e0cceb6d6] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:11.409112 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6e42dbdf-a375-4e78-8428-89b38895e80e tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:11.410578 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6e42dbdf-a375-4e78-8428-89b38895e80e tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:11.411317 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6e42dbdf-a375-4e78-8428-89b38895e80e tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:11.412368 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6e42dbdf-a375-4e78-8428-89b38895e80e tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:11.413060 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6e42dbdf-a375-4e78-8428-89b38895e80e tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:11.414735 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6e42dbdf-a375-4e78-8428-89b38895e80e tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:11.457792 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-6e42dbdf-a375-4e78-8428-89b38895e80e tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/a279a105-ed85-45eb-9725-366e0cceb6d6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064735 Aug 27 02:27:11.463445 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 450/916] 10.222.0.61 () {58 vars in 1302 bytes} [Sat Aug 27 02:27:11 2022] GET /compute/v2.1/servers/a279a105-ed85-45eb-9725-366e0cceb6d6/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:27:11.495695 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [req-c2f93ce2-d05d-4e1a-8b87-d2394ee29ad2 req-887752a6-c4a4-421d-880f-9169e7d429a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fb59350-4f09-4e20-bddb-ffc9a65897b3", "name": "network-vif-unplugged", "status": "completed", "tag": "b6386749-9042-42f7-933e-fe24b60012ef"}]} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:27:11.523275 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-c2f93ce2-d05d-4e1a-8b87-d2394ee29ad2 req-887752a6-c4a4-421d-880f-9169e7d429a4 service nova] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:11.524755 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-c2f93ce2-d05d-4e1a-8b87-d2394ee29ad2 req-887752a6-c4a4-421d-880f-9169e7d429a4 service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:11.525341 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-c2f93ce2-d05d-4e1a-8b87-d2394ee29ad2 req-887752a6-c4a4-421d-880f-9169e7d429a4 service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:11.541077 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.compute.server_external_events [req-c2f93ce2-d05d-4e1a-8b87-d2394ee29ad2 req-887752a6-c4a4-421d-880f-9169e7d429a4 service nova] Unable to find a host for instance 9fb59350-4f09-4e20-bddb-ffc9a65897b3. Dropping event network-vif-unplugged {{(pid=120782) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 27 02:27:11.542610 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [req-c2f93ce2-d05d-4e1a-8b87-d2394ee29ad2 req-887752a6-c4a4-421d-880f-9169e7d429a4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.055666 Aug 27 02:27:11.543351 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 467/917] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Aug 27 02:27:11 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 58 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 27 02:27:11.623714 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-2e4aabbb-b04e-402b-8325-bd6d8c510c60 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:11.624443 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-2e4aabbb-b04e-402b-8325-bd6d8c510c60 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 9cad910f-6edf-4462-9db0-4e7f0a060620] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:11.630853 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2e4aabbb-b04e-402b-8325-bd6d8c510c60 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:11.631429 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2e4aabbb-b04e-402b-8325-bd6d8c510c60 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:11.631936 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2e4aabbb-b04e-402b-8325-bd6d8c510c60 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:11.632715 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2e4aabbb-b04e-402b-8325-bd6d8c510c60 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:11.633240 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2e4aabbb-b04e-402b-8325-bd6d8c510c60 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:11.633824 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2e4aabbb-b04e-402b-8325-bd6d8c510c60 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:11.960703 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-2e4aabbb-b04e-402b-8325-bd6d8c510c60 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fbea2c71674b239e6d8fba6518e962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d9d02db5c49fda33321f2914a7f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:11.975047 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-2e4aabbb-b04e-402b-8325-bd6d8c510c60 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "GET /compute/v2.1/servers/9cad910f-6edf-4462-9db0-4e7f0a060620" status: 200 len: 1673 microversion: 2.1 time: 0.355239 Aug 27 02:27:11.977073 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 451/918] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:11 2022] GET /compute/v2.1/servers/9cad910f-6edf-4462-9db0-4e7f0a060620 => generated 1673 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:12.101585 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-2b246d56-6478-41c6-bbfe-44ae49b20236 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:12.102461 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-2b246d56-6478-41c6-bbfe-44ae49b20236 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] [instance: 9fb59350-4f09-4e20-bddb-ffc9a65897b3] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:12.109327 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2b246d56-6478-41c6-bbfe-44ae49b20236 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:12.109926 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2b246d56-6478-41c6-bbfe-44ae49b20236 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:12.110615 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2b246d56-6478-41c6-bbfe-44ae49b20236 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:12.111246 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2b246d56-6478-41c6-bbfe-44ae49b20236 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:12.111796 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2b246d56-6478-41c6-bbfe-44ae49b20236 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:12.112296 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2b246d56-6478-41c6-bbfe-44ae49b20236 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:12.274903 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-2b246d56-6478-41c6-bbfe-44ae49b20236 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f53d57f3544e5a25e1beeddab9af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2d4ae1c228446eb5bfc64d44348fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:12.283334 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-2b246d56-6478-41c6-bbfe-44ae49b20236 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] 10.222.0.61 "GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3" status: 200 len: 1577 microversion: 2.1 time: 0.185742 Aug 27 02:27:12.284286 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 468/919] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:12 2022] GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3 => generated 1577 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:12.389932 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-63ba29d1-b390-4452-aa9c-ddb80fe93e0c tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:12.390563 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-63ba29d1-b390-4452-aa9c-ddb80fe93e0c tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 99f2f366-4776-427e-99cf-79399835f2c8] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:12.397165 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-63ba29d1-b390-4452-aa9c-ddb80fe93e0c tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:12.397700 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-63ba29d1-b390-4452-aa9c-ddb80fe93e0c tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:12.398154 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-63ba29d1-b390-4452-aa9c-ddb80fe93e0c tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:12.398910 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-63ba29d1-b390-4452-aa9c-ddb80fe93e0c tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:12.399398 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-63ba29d1-b390-4452-aa9c-ddb80fe93e0c tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:12.399804 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-63ba29d1-b390-4452-aa9c-ddb80fe93e0c tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:12.466549 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [req-b4ce3992-a420-432c-b880-e6b8f95357ca req-71efeb2b-3286-407a-a493-d8be3061a996 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9cad910f-6edf-4462-9db0-4e7f0a060620", "name": "network-vif-deleted", "tag": "431c87b1-a7a6-494e-bce0-cc55b95d52f7"}]} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:27:12.483995 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-b4ce3992-a420-432c-b880-e6b8f95357ca req-71efeb2b-3286-407a-a493-d8be3061a996 service nova] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:12.484805 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-b4ce3992-a420-432c-b880-e6b8f95357ca req-71efeb2b-3286-407a-a493-d8be3061a996 service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:12.485439 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-b4ce3992-a420-432c-b880-e6b8f95357ca req-71efeb2b-3286-407a-a493-d8be3061a996 service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:12.499890 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.compute.server_external_events [req-b4ce3992-a420-432c-b880-e6b8f95357ca req-71efeb2b-3286-407a-a493-d8be3061a996 service nova] Creating event network-vif-deleted:431c87b1-a7a6-494e-bce0-cc55b95d52f7 for instance 9cad910f-6edf-4462-9db0-4e7f0a060620 on hv-cinder-84630 Aug 27 02:27:12.505911 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [req-b4ce3992-a420-432c-b880-e6b8f95357ca req-71efeb2b-3286-407a-a493-d8be3061a996 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048547 Aug 27 02:27:12.507143 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 469/920] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Aug 27 02:27:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:27:12.514725 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-0f4e7d84-d986-45e0-848d-ce96c7ab37f1 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:12.522075 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-0f4e7d84-d986-45e0-848d-ce96c7ab37f1 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: a279a105-ed85-45eb-9725-366e0cceb6d6] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:12.533073 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0f4e7d84-d986-45e0-848d-ce96c7ab37f1 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:12.533775 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0f4e7d84-d986-45e0-848d-ce96c7ab37f1 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:12.534284 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0f4e7d84-d986-45e0-848d-ce96c7ab37f1 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:12.535103 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0f4e7d84-d986-45e0-848d-ce96c7ab37f1 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:12.535568 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0f4e7d84-d986-45e0-848d-ce96c7ab37f1 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:12.535994 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0f4e7d84-d986-45e0-848d-ce96c7ab37f1 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:12.588765 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-63ba29d1-b390-4452-aa9c-ddb80fe93e0c tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:12.617038 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-63ba29d1-b390-4452-aa9c-ddb80fe93e0c tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:12.620033 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-63ba29d1-b390-4452-aa9c-ddb80fe93e0c tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:12.621300 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-0f4e7d84-d986-45e0-848d-ce96c7ab37f1 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/a279a105-ed85-45eb-9725-366e0cceb6d6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.112457 Aug 27 02:27:12.621793 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-63ba29d1-b390-4452-aa9c-ddb80fe93e0c tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8" status: 200 len: 1720 microversion: 2.20 time: 0.236316 Aug 27 02:27:12.637453 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 452/921] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:27:12 2022] GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8 => generated 1720 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:27:12.637727 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 470/922] 10.222.0.61 () {58 vars in 1302 bytes} [Sat Aug 27 02:27:12 2022] GET /compute/v2.1/servers/a279a105-ed85-45eb-9725-366e0cceb6d6/os-volume_attachments => generated 197 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:27:12.996364 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-83ba2c30-3dad-4798-a526-28de9340d01d tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:12.996976 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-83ba2c30-3dad-4798-a526-28de9340d01d tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 9cad910f-6edf-4462-9db0-4e7f0a060620] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:13.003941 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-83ba2c30-3dad-4798-a526-28de9340d01d tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:13.004428 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-83ba2c30-3dad-4798-a526-28de9340d01d tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:13.004863 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-83ba2c30-3dad-4798-a526-28de9340d01d tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:13.005624 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-83ba2c30-3dad-4798-a526-28de9340d01d tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:13.006080 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-83ba2c30-3dad-4798-a526-28de9340d01d tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:13.006488 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-83ba2c30-3dad-4798-a526-28de9340d01d tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:13.074113 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-83ba2c30-3dad-4798-a526-28de9340d01d tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fbea2c71674b239e6d8fba6518e962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d9d02db5c49fda33321f2914a7f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:13.082238 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-83ba2c30-3dad-4798-a526-28de9340d01d tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "GET /compute/v2.1/servers/9cad910f-6edf-4462-9db0-4e7f0a060620" status: 200 len: 1605 microversion: 2.1 time: 0.089758 Aug 27 02:27:13.082814 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 453/923] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:12 2022] GET /compute/v2.1/servers/9cad910f-6edf-4462-9db0-4e7f0a060620 => generated 1605 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:13.304849 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-ece087d8-d806-4f16-954e-3f849b226c40 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:13.310934 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-ece087d8-d806-4f16-954e-3f849b226c40 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] [instance: 9fb59350-4f09-4e20-bddb-ffc9a65897b3] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:13.316926 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ece087d8-d806-4f16-954e-3f849b226c40 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:13.317445 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ece087d8-d806-4f16-954e-3f849b226c40 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:13.317892 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ece087d8-d806-4f16-954e-3f849b226c40 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:13.318612 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ece087d8-d806-4f16-954e-3f849b226c40 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:13.319063 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ece087d8-d806-4f16-954e-3f849b226c40 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:13.319500 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ece087d8-d806-4f16-954e-3f849b226c40 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:13.538843 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-ece087d8-d806-4f16-954e-3f849b226c40 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f53d57f3544e5a25e1beeddab9af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2d4ae1c228446eb5bfc64d44348fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:13.548040 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-ece087d8-d806-4f16-954e-3f849b226c40 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] 10.222.0.61 "GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3" status: 200 len: 1577 microversion: 2.1 time: 0.247041 Aug 27 02:27:13.548700 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 471/924] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:13 2022] GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3 => generated 1577 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:13.579363 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [req-55c6b837-bedf-4fa4-ba86-94bf3f2ee5f7 req-1bfd5688-0a10-4804-be4e-2a881573b121 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99f2f366-4776-427e-99cf-79399835f2c8", "name": "network-vif-unplugged", "status": "completed", "tag": "dc94d858-1637-4028-b898-2687b284cae7"}]} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:27:13.590677 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-55c6b837-bedf-4fa4-ba86-94bf3f2ee5f7 req-1bfd5688-0a10-4804-be4e-2a881573b121 service nova] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:13.591152 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-55c6b837-bedf-4fa4-ba86-94bf3f2ee5f7 req-1bfd5688-0a10-4804-be4e-2a881573b121 service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:13.591526 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-55c6b837-bedf-4fa4-ba86-94bf3f2ee5f7 req-1bfd5688-0a10-4804-be4e-2a881573b121 service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:13.606405 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.compute.server_external_events [req-55c6b837-bedf-4fa4-ba86-94bf3f2ee5f7 req-1bfd5688-0a10-4804-be4e-2a881573b121 service nova] Creating event network-vif-unplugged:dc94d858-1637-4028-b898-2687b284cae7 for instance 99f2f366-4776-427e-99cf-79399835f2c8 on hv-cinder-84630 Aug 27 02:27:13.612068 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [req-55c6b837-bedf-4fa4-ba86-94bf3f2ee5f7 req-1bfd5688-0a10-4804-be4e-2a881573b121 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037783 Aug 27 02:27:13.612758 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 454/925] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Aug 27 02:27:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:27:13.647414 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-0390c06a-3b33-4613-a576-6d0567b29c8e tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:13.648174 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-b6688d56-6758-41e6-aa87-218034dc0972 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:13.648977 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-b6688d56-6758-41e6-aa87-218034dc0972 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 99f2f366-4776-427e-99cf-79399835f2c8] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:13.649867 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-0390c06a-3b33-4613-a576-6d0567b29c8e tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: a279a105-ed85-45eb-9725-366e0cceb6d6] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:13.656898 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0390c06a-3b33-4613-a576-6d0567b29c8e tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:13.657683 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0390c06a-3b33-4613-a576-6d0567b29c8e tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:13.658125 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0390c06a-3b33-4613-a576-6d0567b29c8e tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:13.658849 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0390c06a-3b33-4613-a576-6d0567b29c8e tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:13.659351 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0390c06a-3b33-4613-a576-6d0567b29c8e tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:13.659770 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0390c06a-3b33-4613-a576-6d0567b29c8e tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:13.661598 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b6688d56-6758-41e6-aa87-218034dc0972 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:13.662200 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b6688d56-6758-41e6-aa87-218034dc0972 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:13.662734 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b6688d56-6758-41e6-aa87-218034dc0972 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:13.664546 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b6688d56-6758-41e6-aa87-218034dc0972 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:13.665056 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b6688d56-6758-41e6-aa87-218034dc0972 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:13.665860 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b6688d56-6758-41e6-aa87-218034dc0972 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:13.697439 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:27:13.699014 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-0390c06a-3b33-4613-a576-6d0567b29c8e tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/a279a105-ed85-45eb-9725-366e0cceb6d6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056191 Aug 27 02:27:13.709704 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 472/926] 10.222.0.61 () {58 vars in 1302 bytes} [Sat Aug 27 02:27:13 2022] GET /compute/v2.1/servers/a279a105-ed85-45eb-9725-366e0cceb6d6/os-volume_attachments => generated 25 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:27:13.774368 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-0cb7f565-d802-4f7f-8a6b-e2fc3bb3f2bc tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:13.775086 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-0cb7f565-d802-4f7f-8a6b-e2fc3bb3f2bc tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: a279a105-ed85-45eb-9725-366e0cceb6d6] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:13.786863 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0cb7f565-d802-4f7f-8a6b-e2fc3bb3f2bc tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:13.787355 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0cb7f565-d802-4f7f-8a6b-e2fc3bb3f2bc tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:13.787813 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0cb7f565-d802-4f7f-8a6b-e2fc3bb3f2bc tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:13.788523 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0cb7f565-d802-4f7f-8a6b-e2fc3bb3f2bc tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:13.789056 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0cb7f565-d802-4f7f-8a6b-e2fc3bb3f2bc tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:13.789510 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0cb7f565-d802-4f7f-8a6b-e2fc3bb3f2bc tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:13.818057 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-0cb7f565-d802-4f7f-8a6b-e2fc3bb3f2bc tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: a279a105-ed85-45eb-9725-366e0cceb6d6] Going to try to terminate instance {{(pid=120782) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:27:13.827213 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-b6688d56-6758-41e6-aa87-218034dc0972 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:13.836033 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-b6688d56-6758-41e6-aa87-218034dc0972 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:13.837454 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-b6688d56-6758-41e6-aa87-218034dc0972 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:13.851955 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-b6688d56-6758-41e6-aa87-218034dc0972 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8" status: 200 len: 1720 microversion: 2.20 time: 0.195504 Aug 27 02:27:13.870452 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 455/927] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:27:13 2022] GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8 => generated 1720 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:27:14.072587 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-0cb7f565-d802-4f7f-8a6b-e2fc3bb3f2bc tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "DELETE /compute/v2.1/servers/a279a105-ed85-45eb-9725-366e0cceb6d6" status: 204 len: 0 microversion: 2.1 time: 0.302408 Aug 27 02:27:14.076543 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 473/928] 10.222.0.61 () {58 vars in 1239 bytes} [Sat Aug 27 02:27:13 2022] DELETE /compute/v2.1/servers/a279a105-ed85-45eb-9725-366e0cceb6d6 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 02:27:14.082174 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-53ef0755-63bf-494f-a928-378a3d8e5d55 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:14.082773 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-53ef0755-63bf-494f-a928-378a3d8e5d55 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: a279a105-ed85-45eb-9725-366e0cceb6d6] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:14.098034 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-53ef0755-63bf-494f-a928-378a3d8e5d55 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:14.098503 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-53ef0755-63bf-494f-a928-378a3d8e5d55 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:14.101994 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-53ef0755-63bf-494f-a928-378a3d8e5d55 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:14.103016 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-53ef0755-63bf-494f-a928-378a3d8e5d55 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:14.103672 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-53ef0755-63bf-494f-a928-378a3d8e5d55 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:14.104054 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-58a3906e-80a9-46e7-b541-f944246c7f9b tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:14.104657 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-53ef0755-63bf-494f-a928-378a3d8e5d55 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:14.104784 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-58a3906e-80a9-46e7-b541-f944246c7f9b tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 9cad910f-6edf-4462-9db0-4e7f0a060620] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:14.110768 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-58a3906e-80a9-46e7-b541-f944246c7f9b tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:14.111251 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-58a3906e-80a9-46e7-b541-f944246c7f9b tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:14.111868 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-58a3906e-80a9-46e7-b541-f944246c7f9b tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:14.112755 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-58a3906e-80a9-46e7-b541-f944246c7f9b tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:14.113369 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-58a3906e-80a9-46e7-b541-f944246c7f9b tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:14.113812 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-58a3906e-80a9-46e7-b541-f944246c7f9b tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:14.147298 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-58a3906e-80a9-46e7-b541-f944246c7f9b tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:14.147778 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-58a3906e-80a9-46e7-b541-f944246c7f9b tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:14.148210 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-58a3906e-80a9-46e7-b541-f944246c7f9b tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:14.148670 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.objects.instance [None req-58a3906e-80a9-46e7-b541-f944246c7f9b tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lazy-loading 'fault' on Instance uuid 9cad910f-6edf-4462-9db0-4e7f0a060620 {{(pid=120782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:27:14.151595 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:27:14.192676 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-58a3906e-80a9-46e7-b541-f944246c7f9b tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fbea2c71674b239e6d8fba6518e962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d9d02db5c49fda33321f2914a7f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:14.202063 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-58a3906e-80a9-46e7-b541-f944246c7f9b tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "GET /compute/v2.1/servers/9cad910f-6edf-4462-9db0-4e7f0a060620" status: 200 len: 1327 microversion: 2.1 time: 0.102087 Aug 27 02:27:14.202649 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 474/929] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:14 2022] GET /compute/v2.1/servers/9cad910f-6edf-4462-9db0-4e7f0a060620 => generated 1327 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:27:14.267415 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-53ef0755-63bf-494f-a928-378a3d8e5d55 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6f819365574091ae344f14e47f487f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa1c411b57d4e72885dac2b4f4dfe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:14.275820 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-53ef0755-63bf-494f-a928-378a3d8e5d55 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/a279a105-ed85-45eb-9725-366e0cceb6d6" status: 200 len: 1683 microversion: 2.1 time: 0.197952 Aug 27 02:27:14.276407 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 456/930] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:14 2022] GET /compute/v2.1/servers/a279a105-ed85-45eb-9725-366e0cceb6d6 => generated 1683 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:14.569999 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-6c7f1a40-9769-4d90-8a3b-496d25ef797b tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:14.570623 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-6c7f1a40-9769-4d90-8a3b-496d25ef797b tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] [instance: 9fb59350-4f09-4e20-bddb-ffc9a65897b3] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:14.577847 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6c7f1a40-9769-4d90-8a3b-496d25ef797b tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:14.578412 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6c7f1a40-9769-4d90-8a3b-496d25ef797b tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:14.578872 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6c7f1a40-9769-4d90-8a3b-496d25ef797b tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:14.579559 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6c7f1a40-9769-4d90-8a3b-496d25ef797b tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:14.580029 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6c7f1a40-9769-4d90-8a3b-496d25ef797b tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:14.580451 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6c7f1a40-9769-4d90-8a3b-496d25ef797b tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:14.717847 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-6c7f1a40-9769-4d90-8a3b-496d25ef797b tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f53d57f3544e5a25e1beeddab9af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2d4ae1c228446eb5bfc64d44348fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:14.726499 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-6c7f1a40-9769-4d90-8a3b-496d25ef797b tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] 10.222.0.61 "GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3" status: 200 len: 1577 microversion: 2.1 time: 0.160672 Aug 27 02:27:14.727068 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 475/931] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:14 2022] GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3 => generated 1577 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:14.878211 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-e15cc001-8b6b-46a3-8ab4-4fe330163144 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:14.878709 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-e15cc001-8b6b-46a3-8ab4-4fe330163144 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 99f2f366-4776-427e-99cf-79399835f2c8] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:14.884825 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e15cc001-8b6b-46a3-8ab4-4fe330163144 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:14.885303 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e15cc001-8b6b-46a3-8ab4-4fe330163144 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:14.885762 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e15cc001-8b6b-46a3-8ab4-4fe330163144 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:14.886461 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e15cc001-8b6b-46a3-8ab4-4fe330163144 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:14.886910 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e15cc001-8b6b-46a3-8ab4-4fe330163144 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:14.887346 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e15cc001-8b6b-46a3-8ab4-4fe330163144 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:15.023958 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-e15cc001-8b6b-46a3-8ab4-4fe330163144 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:15.032739 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-e15cc001-8b6b-46a3-8ab4-4fe330163144 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:15.034313 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-e15cc001-8b6b-46a3-8ab4-4fe330163144 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:15.035543 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-e15cc001-8b6b-46a3-8ab4-4fe330163144 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8" status: 200 len: 1723 microversion: 2.20 time: 0.161550 Aug 27 02:27:15.036099 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 457/932] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:27:14 2022] GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:27:15.058344 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-7642a0fe-513b-4498-a03d-4f2ff3139cc5 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b726a1fd-8701-457f-9ccf-8ce8972a32bb"}} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:27:15.061026 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-7642a0fe-513b-4498-a03d-4f2ff3139cc5 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 99f2f366-4776-427e-99cf-79399835f2c8] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:15.067450 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7642a0fe-513b-4498-a03d-4f2ff3139cc5 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:15.067929 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7642a0fe-513b-4498-a03d-4f2ff3139cc5 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:15.068352 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7642a0fe-513b-4498-a03d-4f2ff3139cc5 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:15.069035 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7642a0fe-513b-4498-a03d-4f2ff3139cc5 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:15.069548 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7642a0fe-513b-4498-a03d-4f2ff3139cc5 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:15.069944 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7642a0fe-513b-4498-a03d-4f2ff3139cc5 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:15.223265 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-7e31b6bd-e4ae-4ad4-9e86-88f55d219c32 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:15.224591 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-7e31b6bd-e4ae-4ad4-9e86-88f55d219c32 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 9cad910f-6edf-4462-9db0-4e7f0a060620] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:15.231623 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7e31b6bd-e4ae-4ad4-9e86-88f55d219c32 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:15.232116 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7e31b6bd-e4ae-4ad4-9e86-88f55d219c32 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:15.232539 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7e31b6bd-e4ae-4ad4-9e86-88f55d219c32 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:15.233276 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7e31b6bd-e4ae-4ad4-9e86-88f55d219c32 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:15.233919 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7e31b6bd-e4ae-4ad4-9e86-88f55d219c32 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:15.234362 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7e31b6bd-e4ae-4ad4-9e86-88f55d219c32 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:15.270524 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7e31b6bd-e4ae-4ad4-9e86-88f55d219c32 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:15.271466 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7e31b6bd-e4ae-4ad4-9e86-88f55d219c32 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:15.271749 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7e31b6bd-e4ae-4ad4-9e86-88f55d219c32 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:15.272202 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.objects.instance [None req-7e31b6bd-e4ae-4ad4-9e86-88f55d219c32 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lazy-loading 'fault' on Instance uuid 9cad910f-6edf-4462-9db0-4e7f0a060620 {{(pid=120783) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:27:15.319344 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-7e31b6bd-e4ae-4ad4-9e86-88f55d219c32 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fbea2c71674b239e6d8fba6518e962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782d9d02db5c49fda33321f2914a7f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:15.327607 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-7e31b6bd-e4ae-4ad4-9e86-88f55d219c32 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "GET /compute/v2.1/servers/9cad910f-6edf-4462-9db0-4e7f0a060620" status: 200 len: 1327 microversion: 2.1 time: 0.108287 Aug 27 02:27:15.328186 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 458/933] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:15 2022] GET /compute/v2.1/servers/9cad910f-6edf-4462-9db0-4e7f0a060620 => generated 1327 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:15.333151 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-021479db-2777-4a40-b6e5-c658249767da tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:15.333923 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-021479db-2777-4a40-b6e5-c658249767da tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: a279a105-ed85-45eb-9725-366e0cceb6d6] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:15.340208 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-021479db-2777-4a40-b6e5-c658249767da tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:15.340746 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-021479db-2777-4a40-b6e5-c658249767da tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:15.341162 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-021479db-2777-4a40-b6e5-c658249767da tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:15.341886 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-021479db-2777-4a40-b6e5-c658249767da tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:15.342510 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-021479db-2777-4a40-b6e5-c658249767da tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:15.342938 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-021479db-2777-4a40-b6e5-c658249767da tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:15.369543 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-7642a0fe-513b-4498-a03d-4f2ff3139cc5 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "POST /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.315013 Aug 27 02:27:15.370584 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 476/934] 10.222.0.61 () {62 vars in 1364 bytes} [Sat Aug 27 02:27:15 2022] POST /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8/os-volume_attachments => generated 188 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 02:27:15.516856 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-f5ada61b-b6aa-4e3c-9e58-0f455457551f tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:15.517342 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-f5ada61b-b6aa-4e3c-9e58-0f455457551f tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 99f2f366-4776-427e-99cf-79399835f2c8] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:15.523559 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f5ada61b-b6aa-4e3c-9e58-0f455457551f tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:15.524036 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f5ada61b-b6aa-4e3c-9e58-0f455457551f tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:15.524461 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f5ada61b-b6aa-4e3c-9e58-0f455457551f tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:15.525605 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f5ada61b-b6aa-4e3c-9e58-0f455457551f tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:15.526057 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f5ada61b-b6aa-4e3c-9e58-0f455457551f tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:15.526472 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f5ada61b-b6aa-4e3c-9e58-0f455457551f tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:15.539330 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-021479db-2777-4a40-b6e5-c658249767da tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6f819365574091ae344f14e47f487f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa1c411b57d4e72885dac2b4f4dfe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:15.547402 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-021479db-2777-4a40-b6e5-c658249767da tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/a279a105-ed85-45eb-9725-366e0cceb6d6" status: 200 len: 1683 microversion: 2.1 time: 0.218169 Aug 27 02:27:15.547979 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 459/935] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:15 2022] GET /compute/v2.1/servers/a279a105-ed85-45eb-9725-366e0cceb6d6 => generated 1683 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:15.747248 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-bf7582bd-45a1-415d-8720-9470e62cf21a tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:15.747837 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-bf7582bd-45a1-415d-8720-9470e62cf21a tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] [instance: 9fb59350-4f09-4e20-bddb-ffc9a65897b3] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:15.754080 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bf7582bd-45a1-415d-8720-9470e62cf21a tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:15.754578 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bf7582bd-45a1-415d-8720-9470e62cf21a tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:15.755012 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bf7582bd-45a1-415d-8720-9470e62cf21a tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:15.755721 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bf7582bd-45a1-415d-8720-9470e62cf21a tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:15.756172 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bf7582bd-45a1-415d-8720-9470e62cf21a tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:15.756602 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bf7582bd-45a1-415d-8720-9470e62cf21a tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:15.798333 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-f5ada61b-b6aa-4e3c-9e58-0f455457551f tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "DELETE /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8/os-volume_attachments/b726a1fd-8701-457f-9ccf-8ce8972a32bb" status: 202 len: 0 microversion: 2.20 time: 0.286243 Aug 27 02:27:15.799237 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 477/936] 10.222.0.61 () {60 vars in 1457 bytes} [Sat Aug 27 02:27:15 2022] DELETE /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8/os-volume_attachments/b726a1fd-8701-457f-9ccf-8ce8972a32bb => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 27 02:27:15.876151 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-c2959f27-6ee3-4093-b2f4-19eb230b026f tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:27:15.877003 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-c2959f27-6ee3-4093-b2f4-19eb230b026f tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 99f2f366-4776-427e-99cf-79399835f2c8] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:15.891941 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c2959f27-6ee3-4093-b2f4-19eb230b026f tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:15.892496 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c2959f27-6ee3-4093-b2f4-19eb230b026f tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:15.892932 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c2959f27-6ee3-4093-b2f4-19eb230b026f tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:15.893881 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c2959f27-6ee3-4093-b2f4-19eb230b026f tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:15.894389 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c2959f27-6ee3-4093-b2f4-19eb230b026f tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:15.895037 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c2959f27-6ee3-4093-b2f4-19eb230b026f tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:15.937528 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-c2959f27-6ee3-4093-b2f4-19eb230b026f tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 99f2f366-4776-427e-99cf-79399835f2c8] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120782) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 27 02:27:15.963650 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-bf7582bd-45a1-415d-8720-9470e62cf21a tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f53d57f3544e5a25e1beeddab9af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2d4ae1c228446eb5bfc64d44348fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:15.981550 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-bf7582bd-45a1-415d-8720-9470e62cf21a tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] 10.222.0.61 "GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3" status: 200 len: 1577 microversion: 2.1 time: 0.238284 Aug 27 02:27:15.993679 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 460/937] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:15 2022] GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3 => generated 1577 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:16.015306 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-c2959f27-6ee3-4093-b2f4-19eb230b026f tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "POST /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8/action" status: 202 len: 0 microversion: 2.20 time: 0.143161 Aug 27 02:27:16.016117 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 478/938] 10.222.0.61 () {62 vars in 1319 bytes} [Sat Aug 27 02:27:15 2022] POST /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 27 02:27:16.024646 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-985bd8cf-e2c8-49bb-918d-d8eec226c5df tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:16.025889 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-985bd8cf-e2c8-49bb-918d-d8eec226c5df tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 99f2f366-4776-427e-99cf-79399835f2c8] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:16.033448 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-985bd8cf-e2c8-49bb-918d-d8eec226c5df tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:16.034130 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-985bd8cf-e2c8-49bb-918d-d8eec226c5df tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:16.034558 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-985bd8cf-e2c8-49bb-918d-d8eec226c5df tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:16.035290 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-985bd8cf-e2c8-49bb-918d-d8eec226c5df tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:16.036013 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-985bd8cf-e2c8-49bb-918d-d8eec226c5df tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:16.036392 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-985bd8cf-e2c8-49bb-918d-d8eec226c5df tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:16.269680 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-985bd8cf-e2c8-49bb-918d-d8eec226c5df tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:16.291195 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-985bd8cf-e2c8-49bb-918d-d8eec226c5df tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:16.293671 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-985bd8cf-e2c8-49bb-918d-d8eec226c5df tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:16.296022 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-985bd8cf-e2c8-49bb-918d-d8eec226c5df tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8" status: 200 len: 1731 microversion: 2.20 time: 0.275473 Aug 27 02:27:16.312387 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 461/939] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:27:16 2022] GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8 => generated 1731 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:27:16.354669 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-32b066d4-af15-4ef7-aea4-6afb796d9615 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:16.359310 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-32b066d4-af15-4ef7-aea4-6afb796d9615 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 9cad910f-6edf-4462-9db0-4e7f0a060620] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:16.369271 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:27:16.372852 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-32b066d4-af15-4ef7-aea4-6afb796d9615 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:16.373437 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-32b066d4-af15-4ef7-aea4-6afb796d9615 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:16.373905 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-32b066d4-af15-4ef7-aea4-6afb796d9615 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:16.374842 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-32b066d4-af15-4ef7-aea4-6afb796d9615 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:16.375417 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-32b066d4-af15-4ef7-aea4-6afb796d9615 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:16.376068 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-32b066d4-af15-4ef7-aea4-6afb796d9615 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:16.397985 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.wsgi [None req-32b066d4-af15-4ef7-aea4-6afb796d9615 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] HTTP exception thrown: Instance 9cad910f-6edf-4462-9db0-4e7f0a060620 could not be found. Aug 27 02:27:16.400125 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-32b066d4-af15-4ef7-aea4-6afb796d9615 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Request method failure captured: Aug 27 02:27:16.400125 dv-cinder-846303-3-smb devstack@n-api.service[120782]: request: GET /compute/v2.1/servers/9cad910f-6edf-4462-9db0-4e7f0a060620 HTTP/1.1 Aug 27 02:27:16.400125 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Accept: application/json Aug 27 02:27:16.400125 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Accept-Encoding: identity Aug 27 02:27:16.400125 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Connection: close Aug 27 02:27:16.400125 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Content-Length: 0 Aug 27 02:27:16.400125 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Content-Type: application/json Aug 27 02:27:16.400125 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Host: 10.222.0.61 Aug 27 02:27:16.400125 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Openstack-System-Scope: None Aug 27 02:27:16.400125 dv-cinder-846303-3-smb devstack@n-api.service[120782]: User-Agent: python-urllib3/1.26.11 Aug 27 02:27:16.400125 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Auth-Token: gAAAAABjCX-ShfB0Coaj3qVvwoKWmdl3PwzJlje6e22a1Tn3Z-uAvHSJt5iaP5MRmnkzn9IjS7AEfrhus0KHaJgfcKR_uRUzVeWPR9Na-S79Vt8JP774XerEcGj7zs3nh-Whn3Unfno_0WbmWxEFC26pdlS_80IB2Gyidtvp_uirhBgTOiieqV0 Aug 27 02:27:16.400125 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Domain-Id: None Aug 27 02:27:16.400125 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Domain-Name: None Aug 27 02:27:16.400125 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Identity-Status: Confirmed Aug 27 02:27:16.400125 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Is-Admin-Project: True Aug 27 02:27:16.400125 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Domain-Id: default Aug 27 02:27:16.400125 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Domain-Name: Default Aug 27 02:27:16.400125 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Id: 782d9d02db5c49fda33321f2914a7f31 Aug 27 02:27:16.400125 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Name: tempest-AttachVolumeTestJSON-1060962345 Aug 27 02:27:16.400125 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Role: member,reader Aug 27 02:27:16.400125 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Roles: member,reader Aug 27 02:27:16.401818 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/782d9d02db5c49fda33321f2914a7f31"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_782d9d02db5c49fda33321f2914a7f31", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/782d9d02db5c49fda33321f2914a7f31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/782d9d02db5c49fda33321f2914a7f31"}]}] Aug 27 02:27:16.401818 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Tenant: tempest-AttachVolumeTestJSON-1060962345 Aug 27 02:27:16.401818 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Tenant-Id: 782d9d02db5c49fda33321f2914a7f31 Aug 27 02:27:16.401818 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1060962345 Aug 27 02:27:16.401818 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User: tempest-AttachVolumeTestJSON-1060962345-project Aug 27 02:27:16.401818 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Domain-Id: default Aug 27 02:27:16.401818 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Domain-Name: Default Aug 27 02:27:16.401818 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Id: 22fbea2c71674b239e6d8fba6518e962 Aug 27 02:27:16.401818 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Name: tempest-AttachVolumeTestJSON-1060962345-project Aug 27 02:27:16.401818 dv-cinder-846303-3-smb devstack@n-api.service[120782]: method: > Aug 27 02:27:16.401818 dv-cinder-846303-3-smb devstack@n-api.service[120782]: exception: Instance 9cad910f-6edf-4462-9db0-4e7f0a060620 could not be found. Aug 27 02:27:16.401818 dv-cinder-846303-3-smb devstack@n-api.service[120782]: action_args: {'id': '9cad910f-6edf-4462-9db0-4e7f0a060620'} Aug 27 02:27:16.402634 dv-cinder-846303-3-smb devstack@n-api.service[120782]: {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:27:16.402634 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:16.402634 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:27:16.402634 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:27:16.402634 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:27:16.402634 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:27:16.402634 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:27:16.402634 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:27:16.402634 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:27:16.402634 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:27:16.402634 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9cad910f-6edf-4462-9db0-4e7f0a060620 could not be found. Aug 27 02:27:16.402634 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:27:16.402634 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:27:16.402634 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:27:16.402634 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:16.402634 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:27:16.402634 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:27:16.402634 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:27:16.402634 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:27:16.402634 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:27:16.403921 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:27:16.403921 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:27:16.403921 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:27:16.403921 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:27:16.403921 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:27:16.403921 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:27:16.403921 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:27:16.403921 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9cad910f-6edf-4462-9db0-4e7f0a060620 could not be found. Aug 27 02:27:16.403921 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:27:16.403921 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:27:16.403921 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:27:16.403921 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:16.403921 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:27:16.403921 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:27:16.403921 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:27:16.403921 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:27:16.403921 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9cad910f-6edf-4462-9db0-4e7f0a060620 could not be found. Aug 27 02:27:16.403921 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:27:16.405025 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-32b066d4-af15-4ef7-aea4-6afb796d9615 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Returning 404 to user: Instance 9cad910f-6edf-4462-9db0-4e7f0a060620 could not be found. {{(pid=120782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:27:16.405025 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-32b066d4-af15-4ef7-aea4-6afb796d9615 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "GET /compute/v2.1/servers/9cad910f-6edf-4462-9db0-4e7f0a060620" status: 404 len: 111 microversion: 2.1 time: 0.057401 Aug 27 02:27:16.405025 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 479/940] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:16 2022] GET /compute/v2.1/servers/9cad910f-6edf-4462-9db0-4e7f0a060620 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:27:16.413505 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-7de7276a-3101-4fa2-9e57-b96bba96735a tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Calling method '.version_select at 0x7fd8085a5550>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:16.450887 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-7de7276a-3101-4fa2-9e57-b96bba96735a tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-651628831" status: 202 len: 0 microversion: 2.1 time: 0.042063 Aug 27 02:27:16.451995 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 462/941] 10.222.0.61 () {58 vars in 1218 bytes} [Sat Aug 27 02:27:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-651628831 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:27:16.568734 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-a8b2bb97-ec07-4d7e-be01-2408497bdcc6 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:16.569678 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-a8b2bb97-ec07-4d7e-be01-2408497bdcc6 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: a279a105-ed85-45eb-9725-366e0cceb6d6] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:16.581692 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a8b2bb97-ec07-4d7e-be01-2408497bdcc6 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:16.582183 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a8b2bb97-ec07-4d7e-be01-2408497bdcc6 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:16.582617 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a8b2bb97-ec07-4d7e-be01-2408497bdcc6 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:16.583324 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a8b2bb97-ec07-4d7e-be01-2408497bdcc6 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:16.587596 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a8b2bb97-ec07-4d7e-be01-2408497bdcc6 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:16.588253 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a8b2bb97-ec07-4d7e-be01-2408497bdcc6 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:16.933459 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-a8b2bb97-ec07-4d7e-be01-2408497bdcc6 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6f819365574091ae344f14e47f487f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa1c411b57d4e72885dac2b4f4dfe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:16.943962 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-a8b2bb97-ec07-4d7e-be01-2408497bdcc6 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/a279a105-ed85-45eb-9725-366e0cceb6d6" status: 200 len: 1683 microversion: 2.1 time: 0.379502 Aug 27 02:27:16.944550 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 480/942] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:16 2022] GET /compute/v2.1/servers/a279a105-ed85-45eb-9725-366e0cceb6d6 => generated 1683 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:17.005668 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-661f21e7-a8b4-475c-a579-ee64d8095a9f tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:17.006964 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-661f21e7-a8b4-475c-a579-ee64d8095a9f tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] [instance: 9fb59350-4f09-4e20-bddb-ffc9a65897b3] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:17.017548 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-661f21e7-a8b4-475c-a579-ee64d8095a9f tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:17.018040 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-661f21e7-a8b4-475c-a579-ee64d8095a9f tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:17.018616 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-661f21e7-a8b4-475c-a579-ee64d8095a9f tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:17.019517 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-661f21e7-a8b4-475c-a579-ee64d8095a9f tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:17.020005 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-661f21e7-a8b4-475c-a579-ee64d8095a9f tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:17.020479 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-661f21e7-a8b4-475c-a579-ee64d8095a9f tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:17.312351 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-661f21e7-a8b4-475c-a579-ee64d8095a9f tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f53d57f3544e5a25e1beeddab9af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2d4ae1c228446eb5bfc64d44348fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:17.322238 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-661f21e7-a8b4-475c-a579-ee64d8095a9f tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] 10.222.0.61 "GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3" status: 200 len: 1577 microversion: 2.1 time: 0.322626 Aug 27 02:27:17.323082 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 463/943] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:16 2022] GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3 => generated 1577 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:17.337244 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-71cbee2b-71ac-4a2b-aff6-71b0ed16442d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:17.337925 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-71cbee2b-71ac-4a2b-aff6-71b0ed16442d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 99f2f366-4776-427e-99cf-79399835f2c8] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:17.344447 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-71cbee2b-71ac-4a2b-aff6-71b0ed16442d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:17.344943 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-71cbee2b-71ac-4a2b-aff6-71b0ed16442d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:17.345754 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-71cbee2b-71ac-4a2b-aff6-71b0ed16442d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:17.346118 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-71cbee2b-71ac-4a2b-aff6-71b0ed16442d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:17.346652 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-71cbee2b-71ac-4a2b-aff6-71b0ed16442d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:17.347729 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-71cbee2b-71ac-4a2b-aff6-71b0ed16442d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:17.546688 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-71cbee2b-71ac-4a2b-aff6-71b0ed16442d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:17.560410 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-71cbee2b-71ac-4a2b-aff6-71b0ed16442d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:17.561946 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-71cbee2b-71ac-4a2b-aff6-71b0ed16442d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:17.571106 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-71cbee2b-71ac-4a2b-aff6-71b0ed16442d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8" status: 200 len: 1729 microversion: 2.20 time: 0.249967 Aug 27 02:27:17.571913 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 481/944] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:27:17 2022] GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8 => generated 1729 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:27:17.585261 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [req-e594e6a2-b899-4d1b-aa19-ec9d514a8e91 req-235fd01c-1043-47b6-8bb8-0fcd45f94759 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a279a105-ed85-45eb-9725-366e0cceb6d6", "name": "network-vif-deleted", "tag": "3eec6bbd-2647-430f-80b4-d136f3c0de5a"}]} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:27:17.593164 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:27:17.605021 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-e594e6a2-b899-4d1b-aa19-ec9d514a8e91 req-235fd01c-1043-47b6-8bb8-0fcd45f94759 service nova] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:17.605567 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-e594e6a2-b899-4d1b-aa19-ec9d514a8e91 req-235fd01c-1043-47b6-8bb8-0fcd45f94759 service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:17.606087 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-e594e6a2-b899-4d1b-aa19-ec9d514a8e91 req-235fd01c-1043-47b6-8bb8-0fcd45f94759 service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:17.622591 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.compute.server_external_events [req-e594e6a2-b899-4d1b-aa19-ec9d514a8e91 req-235fd01c-1043-47b6-8bb8-0fcd45f94759 service nova] Creating event network-vif-deleted:3eec6bbd-2647-430f-80b4-d136f3c0de5a for instance a279a105-ed85-45eb-9725-366e0cceb6d6 on hv-cinder-84630 Aug 27 02:27:17.628936 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [req-e594e6a2-b899-4d1b-aa19-ec9d514a8e91 req-235fd01c-1043-47b6-8bb8-0fcd45f94759 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049283 Aug 27 02:27:17.630058 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 464/945] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Aug 27 02:27:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:27:17.970860 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-af3e7a3e-83fd-4028-b4ca-d838d56770c0 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:17.971693 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-af3e7a3e-83fd-4028-b4ca-d838d56770c0 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: a279a105-ed85-45eb-9725-366e0cceb6d6] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:17.981425 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-af3e7a3e-83fd-4028-b4ca-d838d56770c0 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:17.982295 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-af3e7a3e-83fd-4028-b4ca-d838d56770c0 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:17.983320 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-af3e7a3e-83fd-4028-b4ca-d838d56770c0 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:17.984569 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-af3e7a3e-83fd-4028-b4ca-d838d56770c0 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:17.985667 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-af3e7a3e-83fd-4028-b4ca-d838d56770c0 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:17.986399 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-af3e7a3e-83fd-4028-b4ca-d838d56770c0 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:18.062024 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-af3e7a3e-83fd-4028-b4ca-d838d56770c0 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6f819365574091ae344f14e47f487f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa1c411b57d4e72885dac2b4f4dfe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:18.077652 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-af3e7a3e-83fd-4028-b4ca-d838d56770c0 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/a279a105-ed85-45eb-9725-366e0cceb6d6" status: 200 len: 1327 microversion: 2.1 time: 0.112729 Aug 27 02:27:18.088959 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 482/946] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:17 2022] GET /compute/v2.1/servers/a279a105-ed85-45eb-9725-366e0cceb6d6 => generated 1327 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:18.345428 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-0626227d-b488-420b-a1ba-8d3f804c4adb tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:18.346346 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-0626227d-b488-420b-a1ba-8d3f804c4adb tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] [instance: 9fb59350-4f09-4e20-bddb-ffc9a65897b3] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:18.355686 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0626227d-b488-420b-a1ba-8d3f804c4adb tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:18.357105 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0626227d-b488-420b-a1ba-8d3f804c4adb tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:18.357811 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0626227d-b488-420b-a1ba-8d3f804c4adb tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:18.358927 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0626227d-b488-420b-a1ba-8d3f804c4adb tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:18.359555 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0626227d-b488-420b-a1ba-8d3f804c4adb tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:18.359972 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0626227d-b488-420b-a1ba-8d3f804c4adb tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:18.530009 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-0626227d-b488-420b-a1ba-8d3f804c4adb tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f53d57f3544e5a25e1beeddab9af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2d4ae1c228446eb5bfc64d44348fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:18.537851 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-0626227d-b488-420b-a1ba-8d3f804c4adb tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] 10.222.0.61 "GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3" status: 200 len: 1577 microversion: 2.1 time: 0.196596 Aug 27 02:27:18.549725 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 465/947] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:18 2022] GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3 => generated 1577 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:18.598771 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-26655d31-749d-48e4-8868-b6d02525030b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:18.599469 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-26655d31-749d-48e4-8868-b6d02525030b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 99f2f366-4776-427e-99cf-79399835f2c8] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:18.606444 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-26655d31-749d-48e4-8868-b6d02525030b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:18.607198 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-26655d31-749d-48e4-8868-b6d02525030b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:18.607851 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-26655d31-749d-48e4-8868-b6d02525030b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:18.608581 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-26655d31-749d-48e4-8868-b6d02525030b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:18.609204 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-26655d31-749d-48e4-8868-b6d02525030b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:18.609792 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-26655d31-749d-48e4-8868-b6d02525030b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:18.768683 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-26655d31-749d-48e4-8868-b6d02525030b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:18.779720 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-26655d31-749d-48e4-8868-b6d02525030b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:18.782034 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-26655d31-749d-48e4-8868-b6d02525030b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:18.783328 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-26655d31-749d-48e4-8868-b6d02525030b tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8" status: 200 len: 1729 microversion: 2.20 time: 0.189867 Aug 27 02:27:18.797856 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 483/948] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:27:18 2022] GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8 => generated 1729 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:27:19.113244 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-94201714-595c-4883-b5d9-ba2b00072abf tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:19.114010 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-94201714-595c-4883-b5d9-ba2b00072abf tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: a279a105-ed85-45eb-9725-366e0cceb6d6] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:19.120642 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-94201714-595c-4883-b5d9-ba2b00072abf tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:19.121289 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-94201714-595c-4883-b5d9-ba2b00072abf tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:19.121837 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-94201714-595c-4883-b5d9-ba2b00072abf tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:19.122661 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-94201714-595c-4883-b5d9-ba2b00072abf tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:19.123218 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-94201714-595c-4883-b5d9-ba2b00072abf tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:19.123739 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-94201714-595c-4883-b5d9-ba2b00072abf tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:19.144910 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.wsgi [None req-94201714-595c-4883-b5d9-ba2b00072abf tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] HTTP exception thrown: Instance a279a105-ed85-45eb-9725-366e0cceb6d6 could not be found. Aug 27 02:27:19.146631 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-94201714-595c-4883-b5d9-ba2b00072abf tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Request method failure captured: Aug 27 02:27:19.146631 dv-cinder-846303-3-smb devstack@n-api.service[120783]: request: GET /compute/v2.1/servers/a279a105-ed85-45eb-9725-366e0cceb6d6 HTTP/1.1 Aug 27 02:27:19.146631 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Accept: application/json Aug 27 02:27:19.146631 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Accept-Encoding: identity Aug 27 02:27:19.146631 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Connection: close Aug 27 02:27:19.146631 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Content-Length: 0 Aug 27 02:27:19.146631 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Content-Type: application/json Aug 27 02:27:19.146631 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Host: 10.222.0.61 Aug 27 02:27:19.146631 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Openstack-System-Scope: None Aug 27 02:27:19.146631 dv-cinder-846303-3-smb devstack@n-api.service[120783]: User-Agent: python-urllib3/1.26.11 Aug 27 02:27:19.146631 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Auth-Token: gAAAAABjCX-GZMxBoDm0UEKrtF9w1zn8zf5k_pRKs9w1w8QBRmamyePi9gdcvRwYzK044f89BKz1wZ6FALfNLv1C6uDnz_VZDZcPY_z2HcyDI5nmMGMvL5rG2v4zh3O1IrszVG_kNPPcMoviX7QaOQhXuRqD1X6DsEJwS6gyWrQ-SPSaYeWVQOw Aug 27 02:27:19.146631 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Domain-Id: None Aug 27 02:27:19.146631 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Domain-Name: None Aug 27 02:27:19.146631 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Identity-Status: Confirmed Aug 27 02:27:19.146631 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Is-Admin-Project: True Aug 27 02:27:19.146631 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Project-Domain-Id: default Aug 27 02:27:19.146631 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Project-Domain-Name: Default Aug 27 02:27:19.146631 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Project-Id: 8aa1c411b57d4e72885dac2b4f4dfe7a Aug 27 02:27:19.146631 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Project-Name: tempest-AttachVolumeNegativeTest-799378516 Aug 27 02:27:19.146631 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Role: member,reader Aug 27 02:27:19.146631 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Roles: member,reader Aug 27 02:27:19.148231 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/8aa1c411b57d4e72885dac2b4f4dfe7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_8aa1c411b57d4e72885dac2b4f4dfe7a", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8aa1c411b57d4e72885dac2b4f4dfe7a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8aa1c411b57d4e72885dac2b4f4dfe7a"}]}] Aug 27 02:27:19.148231 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Tenant: tempest-AttachVolumeNegativeTest-799378516 Aug 27 02:27:19.148231 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Tenant-Id: 8aa1c411b57d4e72885dac2b4f4dfe7a Aug 27 02:27:19.148231 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-799378516 Aug 27 02:27:19.148231 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User: tempest-AttachVolumeNegativeTest-799378516-project Aug 27 02:27:19.148231 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User-Domain-Id: default Aug 27 02:27:19.148231 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User-Domain-Name: Default Aug 27 02:27:19.148231 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User-Id: 4a6f819365574091ae344f14e47f487f Aug 27 02:27:19.148231 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User-Name: tempest-AttachVolumeNegativeTest-799378516-project Aug 27 02:27:19.148231 dv-cinder-846303-3-smb devstack@n-api.service[120783]: method: > Aug 27 02:27:19.148231 dv-cinder-846303-3-smb devstack@n-api.service[120783]: exception: Instance a279a105-ed85-45eb-9725-366e0cceb6d6 could not be found. Aug 27 02:27:19.148231 dv-cinder-846303-3-smb devstack@n-api.service[120783]: action_args: {'id': 'a279a105-ed85-45eb-9725-366e0cceb6d6'} Aug 27 02:27:19.149171 dv-cinder-846303-3-smb devstack@n-api.service[120783]: {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:27:19.149171 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:19.149171 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:27:19.149171 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:27:19.149171 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:27:19.149171 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:27:19.149171 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:27:19.149171 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:27:19.149171 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:27:19.149171 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:27:19.149171 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a279a105-ed85-45eb-9725-366e0cceb6d6 could not be found. Aug 27 02:27:19.149171 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:27:19.149171 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:27:19.149171 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:27:19.149171 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:19.149171 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:27:19.149171 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:27:19.149171 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:27:19.149171 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:27:19.149171 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:27:19.150669 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:27:19.150669 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:27:19.150669 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:27:19.150669 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:27:19.150669 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:27:19.150669 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:27:19.150669 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:27:19.150669 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a279a105-ed85-45eb-9725-366e0cceb6d6 could not be found. Aug 27 02:27:19.150669 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:27:19.150669 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:27:19.150669 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:27:19.150669 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:19.150669 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:27:19.150669 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:27:19.150669 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:27:19.150669 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:27:19.150669 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a279a105-ed85-45eb-9725-366e0cceb6d6 could not be found. Aug 27 02:27:19.150669 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:27:19.151954 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-94201714-595c-4883-b5d9-ba2b00072abf tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Returning 404 to user: Instance a279a105-ed85-45eb-9725-366e0cceb6d6 could not be found. {{(pid=120783) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:27:19.151954 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-94201714-595c-4883-b5d9-ba2b00072abf tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/a279a105-ed85-45eb-9725-366e0cceb6d6" status: 404 len: 111 microversion: 2.1 time: 0.039101 Aug 27 02:27:19.151954 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 466/949] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:19 2022] GET /compute/v2.1/servers/a279a105-ed85-45eb-9725-366e0cceb6d6 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:27:19.159442 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-c602728c-b46e-405e-81d6-3a319677aac9 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '.version_select at 0x7fd8083d6a60>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:19.182456 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-c602728c-b46e-405e-81d6-3a319677aac9 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1347803859" status: 202 len: 0 microversion: 2.1 time: 0.028626 Aug 27 02:27:19.183144 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 484/950] 10.222.0.61 () {58 vars in 1221 bytes} [Sat Aug 27 02:27:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1347803859 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 02:27:19.560373 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-f04b58ec-f1b2-496c-b803-47777a685f97 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:19.561022 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-f04b58ec-f1b2-496c-b803-47777a685f97 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] [instance: 9fb59350-4f09-4e20-bddb-ffc9a65897b3] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:19.569286 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f04b58ec-f1b2-496c-b803-47777a685f97 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:19.570184 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f04b58ec-f1b2-496c-b803-47777a685f97 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:19.570620 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f04b58ec-f1b2-496c-b803-47777a685f97 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:19.571505 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f04b58ec-f1b2-496c-b803-47777a685f97 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:19.573509 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f04b58ec-f1b2-496c-b803-47777a685f97 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:19.574194 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f04b58ec-f1b2-496c-b803-47777a685f97 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:19.685261 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-ae60cc25-b84d-47b8-ae89-e43412c8adcd tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:19.686009 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-ae60cc25-b84d-47b8-ae89-e43412c8adcd tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 9cad910f-6edf-4462-9db0-4e7f0a060620] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:19.695834 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ae60cc25-b84d-47b8-ae89-e43412c8adcd tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:19.696864 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ae60cc25-b84d-47b8-ae89-e43412c8adcd tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:19.697681 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ae60cc25-b84d-47b8-ae89-e43412c8adcd tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:19.699358 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ae60cc25-b84d-47b8-ae89-e43412c8adcd tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:19.700258 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ae60cc25-b84d-47b8-ae89-e43412c8adcd tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:19.700803 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ae60cc25-b84d-47b8-ae89-e43412c8adcd tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:19.725542 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.wsgi [None req-ae60cc25-b84d-47b8-ae89-e43412c8adcd tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] HTTP exception thrown: Instance 9cad910f-6edf-4462-9db0-4e7f0a060620 could not be found. Aug 27 02:27:19.727573 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-ae60cc25-b84d-47b8-ae89-e43412c8adcd tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Request method failure captured: Aug 27 02:27:19.727573 dv-cinder-846303-3-smb devstack@n-api.service[120782]: request: DELETE /compute/v2.1/servers/9cad910f-6edf-4462-9db0-4e7f0a060620 HTTP/1.1 Aug 27 02:27:19.727573 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Accept: application/json Aug 27 02:27:19.727573 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Accept-Encoding: identity Aug 27 02:27:19.727573 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Connection: close Aug 27 02:27:19.727573 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Content-Length: 0 Aug 27 02:27:19.727573 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Content-Type: application/json Aug 27 02:27:19.727573 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Host: 10.222.0.61 Aug 27 02:27:19.727573 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Openstack-System-Scope: None Aug 27 02:27:19.727573 dv-cinder-846303-3-smb devstack@n-api.service[120782]: User-Agent: python-urllib3/1.26.11 Aug 27 02:27:19.727573 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Auth-Token: gAAAAABjCX-ShfB0Coaj3qVvwoKWmdl3PwzJlje6e22a1Tn3Z-uAvHSJt5iaP5MRmnkzn9IjS7AEfrhus0KHaJgfcKR_uRUzVeWPR9Na-S79Vt8JP774XerEcGj7zs3nh-Whn3Unfno_0WbmWxEFC26pdlS_80IB2Gyidtvp_uirhBgTOiieqV0 Aug 27 02:27:19.727573 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Domain-Id: None Aug 27 02:27:19.727573 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Domain-Name: None Aug 27 02:27:19.727573 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Identity-Status: Confirmed Aug 27 02:27:19.727573 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Is-Admin-Project: True Aug 27 02:27:19.727573 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Domain-Id: default Aug 27 02:27:19.727573 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Domain-Name: Default Aug 27 02:27:19.727573 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Id: 782d9d02db5c49fda33321f2914a7f31 Aug 27 02:27:19.727573 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Name: tempest-AttachVolumeTestJSON-1060962345 Aug 27 02:27:19.727573 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Role: member,reader Aug 27 02:27:19.727573 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Roles: member,reader Aug 27 02:27:19.729237 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/782d9d02db5c49fda33321f2914a7f31"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_782d9d02db5c49fda33321f2914a7f31", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/782d9d02db5c49fda33321f2914a7f31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/782d9d02db5c49fda33321f2914a7f31"}]}] Aug 27 02:27:19.729237 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Tenant: tempest-AttachVolumeTestJSON-1060962345 Aug 27 02:27:19.729237 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Tenant-Id: 782d9d02db5c49fda33321f2914a7f31 Aug 27 02:27:19.729237 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1060962345 Aug 27 02:27:19.729237 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User: tempest-AttachVolumeTestJSON-1060962345-project Aug 27 02:27:19.729237 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Domain-Id: default Aug 27 02:27:19.729237 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Domain-Name: Default Aug 27 02:27:19.729237 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Id: 22fbea2c71674b239e6d8fba6518e962 Aug 27 02:27:19.729237 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Name: tempest-AttachVolumeTestJSON-1060962345-project Aug 27 02:27:19.729237 dv-cinder-846303-3-smb devstack@n-api.service[120782]: method: > Aug 27 02:27:19.729237 dv-cinder-846303-3-smb devstack@n-api.service[120782]: exception: Instance 9cad910f-6edf-4462-9db0-4e7f0a060620 could not be found. Aug 27 02:27:19.729237 dv-cinder-846303-3-smb devstack@n-api.service[120782]: action_args: {'id': '9cad910f-6edf-4462-9db0-4e7f0a060620'} Aug 27 02:27:19.730194 dv-cinder-846303-3-smb devstack@n-api.service[120782]: {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:27:19.730194 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:19.730194 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:27:19.730194 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:27:19.730194 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:27:19.730194 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:27:19.730194 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:27:19.730194 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:27:19.730194 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:27:19.730194 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:27:19.730194 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9cad910f-6edf-4462-9db0-4e7f0a060620 could not be found. Aug 27 02:27:19.730194 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:27:19.730194 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:27:19.730194 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:27:19.730194 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:19.730194 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:27:19.730194 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:27:19.730194 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:27:19.730194 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:27:19.730194 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:27:19.731591 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:27:19.731591 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 02:27:19.731591 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 02:27:19.731591 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 02:27:19.731591 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 02:27:19.731591 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:27:19.731591 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:27:19.731591 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:27:19.731591 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:27:19.731591 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9cad910f-6edf-4462-9db0-4e7f0a060620 could not be found. Aug 27 02:27:19.731591 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:27:19.731591 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:27:19.731591 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:27:19.731591 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:19.731591 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:27:19.731591 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:27:19.731591 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:27:19.731591 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:27:19.731591 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9cad910f-6edf-4462-9db0-4e7f0a060620 could not be found. Aug 27 02:27:19.731591 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:27:19.733047 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-ae60cc25-b84d-47b8-ae89-e43412c8adcd tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Returning 404 to user: Instance 9cad910f-6edf-4462-9db0-4e7f0a060620 could not be found. {{(pid=120782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:27:19.734181 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-ae60cc25-b84d-47b8-ae89-e43412c8adcd tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "DELETE /compute/v2.1/servers/9cad910f-6edf-4462-9db0-4e7f0a060620" status: 404 len: 111 microversion: 2.1 time: 0.054173 Aug 27 02:27:19.734922 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 485/951] 10.222.0.61 () {58 vars in 1239 bytes} [Sat Aug 27 02:27:19 2022] DELETE /compute/v2.1/servers/9cad910f-6edf-4462-9db0-4e7f0a060620 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 02:27:19.743799 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-2afa526d-8908-4c2f-9db4-46a7ea201e91 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:19.744412 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-2afa526d-8908-4c2f-9db4-46a7ea201e91 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 9cad910f-6edf-4462-9db0-4e7f0a060620] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:19.753259 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2afa526d-8908-4c2f-9db4-46a7ea201e91 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:19.754039 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2afa526d-8908-4c2f-9db4-46a7ea201e91 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:19.754650 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2afa526d-8908-4c2f-9db4-46a7ea201e91 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:19.755659 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2afa526d-8908-4c2f-9db4-46a7ea201e91 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:19.756258 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2afa526d-8908-4c2f-9db4-46a7ea201e91 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:19.757058 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2afa526d-8908-4c2f-9db4-46a7ea201e91 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:19.773241 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.wsgi [None req-2afa526d-8908-4c2f-9db4-46a7ea201e91 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] HTTP exception thrown: Instance 9cad910f-6edf-4462-9db0-4e7f0a060620 could not be found. Aug 27 02:27:19.774820 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-2afa526d-8908-4c2f-9db4-46a7ea201e91 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Request method failure captured: Aug 27 02:27:19.774820 dv-cinder-846303-3-smb devstack@n-api.service[120782]: request: GET /compute/v2.1/servers/9cad910f-6edf-4462-9db0-4e7f0a060620 HTTP/1.1 Aug 27 02:27:19.774820 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Accept: application/json Aug 27 02:27:19.774820 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Accept-Encoding: identity Aug 27 02:27:19.774820 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Connection: close Aug 27 02:27:19.774820 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Content-Length: 0 Aug 27 02:27:19.774820 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Content-Type: application/json Aug 27 02:27:19.774820 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Host: 10.222.0.61 Aug 27 02:27:19.774820 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Openstack-System-Scope: None Aug 27 02:27:19.774820 dv-cinder-846303-3-smb devstack@n-api.service[120782]: User-Agent: python-urllib3/1.26.11 Aug 27 02:27:19.774820 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Auth-Token: gAAAAABjCX-ShfB0Coaj3qVvwoKWmdl3PwzJlje6e22a1Tn3Z-uAvHSJt5iaP5MRmnkzn9IjS7AEfrhus0KHaJgfcKR_uRUzVeWPR9Na-S79Vt8JP774XerEcGj7zs3nh-Whn3Unfno_0WbmWxEFC26pdlS_80IB2Gyidtvp_uirhBgTOiieqV0 Aug 27 02:27:19.774820 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Domain-Id: None Aug 27 02:27:19.774820 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Domain-Name: None Aug 27 02:27:19.774820 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Identity-Status: Confirmed Aug 27 02:27:19.774820 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Is-Admin-Project: True Aug 27 02:27:19.774820 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Domain-Id: default Aug 27 02:27:19.774820 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Domain-Name: Default Aug 27 02:27:19.774820 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Id: 782d9d02db5c49fda33321f2914a7f31 Aug 27 02:27:19.774820 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Name: tempest-AttachVolumeTestJSON-1060962345 Aug 27 02:27:19.774820 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Role: member,reader Aug 27 02:27:19.774820 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Roles: member,reader Aug 27 02:27:19.780281 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/782d9d02db5c49fda33321f2914a7f31"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_782d9d02db5c49fda33321f2914a7f31", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/782d9d02db5c49fda33321f2914a7f31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/782d9d02db5c49fda33321f2914a7f31"}]}] Aug 27 02:27:19.780281 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Tenant: tempest-AttachVolumeTestJSON-1060962345 Aug 27 02:27:19.780281 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Tenant-Id: 782d9d02db5c49fda33321f2914a7f31 Aug 27 02:27:19.780281 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1060962345 Aug 27 02:27:19.780281 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User: tempest-AttachVolumeTestJSON-1060962345-project Aug 27 02:27:19.780281 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Domain-Id: default Aug 27 02:27:19.780281 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Domain-Name: Default Aug 27 02:27:19.780281 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Id: 22fbea2c71674b239e6d8fba6518e962 Aug 27 02:27:19.780281 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Name: tempest-AttachVolumeTestJSON-1060962345-project Aug 27 02:27:19.780281 dv-cinder-846303-3-smb devstack@n-api.service[120782]: method: > Aug 27 02:27:19.780281 dv-cinder-846303-3-smb devstack@n-api.service[120782]: exception: Instance 9cad910f-6edf-4462-9db0-4e7f0a060620 could not be found. Aug 27 02:27:19.780281 dv-cinder-846303-3-smb devstack@n-api.service[120782]: action_args: {'id': '9cad910f-6edf-4462-9db0-4e7f0a060620'} Aug 27 02:27:19.781301 dv-cinder-846303-3-smb devstack@n-api.service[120782]: {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:27:19.781301 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:19.781301 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:27:19.781301 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:27:19.781301 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:27:19.781301 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:27:19.781301 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:27:19.781301 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:27:19.781301 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:27:19.781301 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:27:19.781301 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9cad910f-6edf-4462-9db0-4e7f0a060620 could not be found. Aug 27 02:27:19.781301 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:27:19.781301 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:27:19.781301 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:27:19.781301 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:19.781301 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:27:19.781301 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:27:19.781301 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:27:19.781301 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:27:19.781301 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:27:19.782551 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:27:19.782551 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:27:19.782551 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:27:19.782551 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:27:19.782551 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:27:19.782551 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:27:19.782551 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:27:19.782551 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9cad910f-6edf-4462-9db0-4e7f0a060620 could not be found. Aug 27 02:27:19.782551 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:27:19.782551 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:27:19.782551 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:27:19.782551 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:19.782551 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:27:19.782551 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:27:19.782551 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:27:19.782551 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:27:19.782551 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9cad910f-6edf-4462-9db0-4e7f0a060620 could not be found. Aug 27 02:27:19.782551 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:27:19.784697 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-2afa526d-8908-4c2f-9db4-46a7ea201e91 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Returning 404 to user: Instance 9cad910f-6edf-4462-9db0-4e7f0a060620 could not be found. {{(pid=120782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:27:19.784697 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-2afa526d-8908-4c2f-9db4-46a7ea201e91 tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "GET /compute/v2.1/servers/9cad910f-6edf-4462-9db0-4e7f0a060620" status: 404 len: 111 microversion: 2.1 time: 0.036653 Aug 27 02:27:19.784697 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 486/952] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:19 2022] GET /compute/v2.1/servers/9cad910f-6edf-4462-9db0-4e7f0a060620 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 02:27:19.808377 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-c0e19c0d-4e4b-4d2d-8fba-b3d83459fd0c tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:19.810183 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-c0e19c0d-4e4b-4d2d-8fba-b3d83459fd0c tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 99f2f366-4776-427e-99cf-79399835f2c8] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:19.817481 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c0e19c0d-4e4b-4d2d-8fba-b3d83459fd0c tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:19.818013 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c0e19c0d-4e4b-4d2d-8fba-b3d83459fd0c tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:19.818567 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c0e19c0d-4e4b-4d2d-8fba-b3d83459fd0c tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:19.819323 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c0e19c0d-4e4b-4d2d-8fba-b3d83459fd0c tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:19.820098 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c0e19c0d-4e4b-4d2d-8fba-b3d83459fd0c tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:19.820681 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c0e19c0d-4e4b-4d2d-8fba-b3d83459fd0c tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:19.958957 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-f04b58ec-f1b2-496c-b803-47777a685f97 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f53d57f3544e5a25e1beeddab9af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2d4ae1c228446eb5bfc64d44348fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:19.986454 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-f04b58ec-f1b2-496c-b803-47777a685f97 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] 10.222.0.61 "GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3" status: 200 len: 1577 microversion: 2.1 time: 0.428251 Aug 27 02:27:19.988282 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 467/953] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:19 2022] GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3 => generated 1577 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:20.088822 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-c0e19c0d-4e4b-4d2d-8fba-b3d83459fd0c tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:20.106787 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-c0e19c0d-4e4b-4d2d-8fba-b3d83459fd0c tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:20.123738 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-c0e19c0d-4e4b-4d2d-8fba-b3d83459fd0c tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:20.129344 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-c0e19c0d-4e4b-4d2d-8fba-b3d83459fd0c tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8" status: 200 len: 1729 microversion: 2.20 time: 0.325625 Aug 27 02:27:20.143722 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 487/954] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:27:19 2022] GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8 => generated 1729 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:27:21.013000 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-0f41c96d-8ae0-4ea2-85d1-68ca25f84585 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:21.013833 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-0f41c96d-8ae0-4ea2-85d1-68ca25f84585 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] [instance: 9fb59350-4f09-4e20-bddb-ffc9a65897b3] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:21.025387 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0f41c96d-8ae0-4ea2-85d1-68ca25f84585 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:21.026035 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0f41c96d-8ae0-4ea2-85d1-68ca25f84585 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:21.026589 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0f41c96d-8ae0-4ea2-85d1-68ca25f84585 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:21.027361 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0f41c96d-8ae0-4ea2-85d1-68ca25f84585 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:21.027804 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0f41c96d-8ae0-4ea2-85d1-68ca25f84585 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:21.028416 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0f41c96d-8ae0-4ea2-85d1-68ca25f84585 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:21.064567 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-07145800-5cac-4650-9863-dd130e1b37bb tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:21.065915 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-07145800-5cac-4650-9863-dd130e1b37bb tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 4fedf0d1-cc1c-4947-b92e-dcb4454889d1] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:21.074087 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-07145800-5cac-4650-9863-dd130e1b37bb tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:21.075085 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-07145800-5cac-4650-9863-dd130e1b37bb tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:21.075775 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-07145800-5cac-4650-9863-dd130e1b37bb tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:21.076724 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-07145800-5cac-4650-9863-dd130e1b37bb tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:21.077303 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-07145800-5cac-4650-9863-dd130e1b37bb tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:21.081353 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-07145800-5cac-4650-9863-dd130e1b37bb tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:21.085012 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell1:SELECT=85,nova_cell1:INSERT=6,nova_cell1:UPDATE=9 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:27:21.123274 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.wsgi [None req-07145800-5cac-4650-9863-dd130e1b37bb tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] HTTP exception thrown: Instance 4fedf0d1-cc1c-4947-b92e-dcb4454889d1 could not be found. Aug 27 02:27:21.124844 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-07145800-5cac-4650-9863-dd130e1b37bb tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Request method failure captured: Aug 27 02:27:21.124844 dv-cinder-846303-3-smb devstack@n-api.service[120782]: request: DELETE /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1 HTTP/1.1 Aug 27 02:27:21.124844 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Accept: application/json Aug 27 02:27:21.124844 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Accept-Encoding: identity Aug 27 02:27:21.124844 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Connection: close Aug 27 02:27:21.124844 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Content-Length: 0 Aug 27 02:27:21.124844 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Content-Type: application/json Aug 27 02:27:21.124844 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Host: 10.222.0.61 Aug 27 02:27:21.124844 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Openstack-System-Scope: None Aug 27 02:27:21.124844 dv-cinder-846303-3-smb devstack@n-api.service[120782]: User-Agent: python-urllib3/1.26.11 Aug 27 02:27:21.124844 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Auth-Token: gAAAAABjCX-ShfB0Coaj3qVvwoKWmdl3PwzJlje6e22a1Tn3Z-uAvHSJt5iaP5MRmnkzn9IjS7AEfrhus0KHaJgfcKR_uRUzVeWPR9Na-S79Vt8JP774XerEcGj7zs3nh-Whn3Unfno_0WbmWxEFC26pdlS_80IB2Gyidtvp_uirhBgTOiieqV0 Aug 27 02:27:21.124844 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Domain-Id: None Aug 27 02:27:21.124844 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Domain-Name: None Aug 27 02:27:21.124844 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Identity-Status: Confirmed Aug 27 02:27:21.124844 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Is-Admin-Project: True Aug 27 02:27:21.124844 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Domain-Id: default Aug 27 02:27:21.124844 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Domain-Name: Default Aug 27 02:27:21.124844 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Id: 782d9d02db5c49fda33321f2914a7f31 Aug 27 02:27:21.124844 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Name: tempest-AttachVolumeTestJSON-1060962345 Aug 27 02:27:21.124844 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Role: member,reader Aug 27 02:27:21.124844 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Roles: member,reader Aug 27 02:27:21.126494 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/782d9d02db5c49fda33321f2914a7f31"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_782d9d02db5c49fda33321f2914a7f31", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/782d9d02db5c49fda33321f2914a7f31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/782d9d02db5c49fda33321f2914a7f31"}]}] Aug 27 02:27:21.126494 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Tenant: tempest-AttachVolumeTestJSON-1060962345 Aug 27 02:27:21.126494 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Tenant-Id: 782d9d02db5c49fda33321f2914a7f31 Aug 27 02:27:21.126494 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1060962345 Aug 27 02:27:21.126494 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User: tempest-AttachVolumeTestJSON-1060962345-project Aug 27 02:27:21.126494 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Domain-Id: default Aug 27 02:27:21.126494 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Domain-Name: Default Aug 27 02:27:21.126494 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Id: 22fbea2c71674b239e6d8fba6518e962 Aug 27 02:27:21.126494 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Name: tempest-AttachVolumeTestJSON-1060962345-project Aug 27 02:27:21.126494 dv-cinder-846303-3-smb devstack@n-api.service[120782]: method: > Aug 27 02:27:21.126494 dv-cinder-846303-3-smb devstack@n-api.service[120782]: exception: Instance 4fedf0d1-cc1c-4947-b92e-dcb4454889d1 could not be found. Aug 27 02:27:21.126494 dv-cinder-846303-3-smb devstack@n-api.service[120782]: action_args: {'id': '4fedf0d1-cc1c-4947-b92e-dcb4454889d1'} Aug 27 02:27:21.127377 dv-cinder-846303-3-smb devstack@n-api.service[120782]: {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:27:21.127377 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:21.127377 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:27:21.127377 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:27:21.127377 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:27:21.127377 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:27:21.127377 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:27:21.127377 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:27:21.127377 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:27:21.127377 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:27:21.127377 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fedf0d1-cc1c-4947-b92e-dcb4454889d1 could not be found. Aug 27 02:27:21.127377 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:27:21.127377 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:27:21.127377 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:27:21.127377 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:21.127377 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:27:21.127377 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:27:21.127377 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:27:21.127377 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:27:21.127377 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:27:21.129106 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:27:21.129106 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 02:27:21.129106 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 02:27:21.129106 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 02:27:21.129106 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 02:27:21.129106 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:27:21.129106 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:27:21.129106 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:27:21.129106 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:27:21.129106 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fedf0d1-cc1c-4947-b92e-dcb4454889d1 could not be found. Aug 27 02:27:21.129106 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:27:21.129106 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:27:21.129106 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:27:21.129106 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:21.129106 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:27:21.129106 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:27:21.129106 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:27:21.129106 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:27:21.129106 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fedf0d1-cc1c-4947-b92e-dcb4454889d1 could not be found. Aug 27 02:27:21.129106 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:27:21.132037 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-07145800-5cac-4650-9863-dd130e1b37bb tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Returning 404 to user: Instance 4fedf0d1-cc1c-4947-b92e-dcb4454889d1 could not be found. {{(pid=120782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:27:21.133102 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-07145800-5cac-4650-9863-dd130e1b37bb tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "DELETE /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1" status: 404 len: 111 microversion: 2.1 time: 0.072822 Aug 27 02:27:21.134015 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 488/955] 10.222.0.61 () {58 vars in 1239 bytes} [Sat Aug 27 02:27:21 2022] DELETE /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:27:21.142737 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-2018ff15-e52d-4684-bd33-be420094611e tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:21.143414 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-2018ff15-e52d-4684-bd33-be420094611e tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] [instance: 4fedf0d1-cc1c-4947-b92e-dcb4454889d1] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:21.171815 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2018ff15-e52d-4684-bd33-be420094611e tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:21.172309 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2018ff15-e52d-4684-bd33-be420094611e tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:21.172750 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2018ff15-e52d-4684-bd33-be420094611e tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:21.173667 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2018ff15-e52d-4684-bd33-be420094611e tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:21.174562 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2018ff15-e52d-4684-bd33-be420094611e tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:21.175037 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2018ff15-e52d-4684-bd33-be420094611e tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:21.194801 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.wsgi [None req-2018ff15-e52d-4684-bd33-be420094611e tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] HTTP exception thrown: Instance 4fedf0d1-cc1c-4947-b92e-dcb4454889d1 could not be found. Aug 27 02:27:21.196350 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-2018ff15-e52d-4684-bd33-be420094611e tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Request method failure captured: Aug 27 02:27:21.196350 dv-cinder-846303-3-smb devstack@n-api.service[120782]: request: GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1 HTTP/1.1 Aug 27 02:27:21.196350 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Accept: application/json Aug 27 02:27:21.196350 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Accept-Encoding: identity Aug 27 02:27:21.196350 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Connection: close Aug 27 02:27:21.196350 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Content-Length: 0 Aug 27 02:27:21.196350 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Content-Type: application/json Aug 27 02:27:21.196350 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Host: 10.222.0.61 Aug 27 02:27:21.196350 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Openstack-System-Scope: None Aug 27 02:27:21.196350 dv-cinder-846303-3-smb devstack@n-api.service[120782]: User-Agent: python-urllib3/1.26.11 Aug 27 02:27:21.196350 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Auth-Token: gAAAAABjCX-ShfB0Coaj3qVvwoKWmdl3PwzJlje6e22a1Tn3Z-uAvHSJt5iaP5MRmnkzn9IjS7AEfrhus0KHaJgfcKR_uRUzVeWPR9Na-S79Vt8JP774XerEcGj7zs3nh-Whn3Unfno_0WbmWxEFC26pdlS_80IB2Gyidtvp_uirhBgTOiieqV0 Aug 27 02:27:21.196350 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Domain-Id: None Aug 27 02:27:21.196350 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Domain-Name: None Aug 27 02:27:21.196350 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Identity-Status: Confirmed Aug 27 02:27:21.196350 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Is-Admin-Project: True Aug 27 02:27:21.196350 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Domain-Id: default Aug 27 02:27:21.196350 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Domain-Name: Default Aug 27 02:27:21.196350 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Id: 782d9d02db5c49fda33321f2914a7f31 Aug 27 02:27:21.196350 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Name: tempest-AttachVolumeTestJSON-1060962345 Aug 27 02:27:21.196350 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Role: member,reader Aug 27 02:27:21.196350 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Roles: member,reader Aug 27 02:27:21.198009 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/782d9d02db5c49fda33321f2914a7f31"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_782d9d02db5c49fda33321f2914a7f31", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/782d9d02db5c49fda33321f2914a7f31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/782d9d02db5c49fda33321f2914a7f31"}]}] Aug 27 02:27:21.198009 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Tenant: tempest-AttachVolumeTestJSON-1060962345 Aug 27 02:27:21.198009 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Tenant-Id: 782d9d02db5c49fda33321f2914a7f31 Aug 27 02:27:21.198009 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1060962345 Aug 27 02:27:21.198009 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User: tempest-AttachVolumeTestJSON-1060962345-project Aug 27 02:27:21.198009 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Domain-Id: default Aug 27 02:27:21.198009 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Domain-Name: Default Aug 27 02:27:21.198009 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Id: 22fbea2c71674b239e6d8fba6518e962 Aug 27 02:27:21.198009 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Name: tempest-AttachVolumeTestJSON-1060962345-project Aug 27 02:27:21.198009 dv-cinder-846303-3-smb devstack@n-api.service[120782]: method: > Aug 27 02:27:21.198009 dv-cinder-846303-3-smb devstack@n-api.service[120782]: exception: Instance 4fedf0d1-cc1c-4947-b92e-dcb4454889d1 could not be found. Aug 27 02:27:21.198009 dv-cinder-846303-3-smb devstack@n-api.service[120782]: action_args: {'id': '4fedf0d1-cc1c-4947-b92e-dcb4454889d1'} Aug 27 02:27:21.198883 dv-cinder-846303-3-smb devstack@n-api.service[120782]: {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:27:21.198883 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:21.198883 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:27:21.198883 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:27:21.198883 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:27:21.198883 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:27:21.198883 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:27:21.198883 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:27:21.198883 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:27:21.198883 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:27:21.198883 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fedf0d1-cc1c-4947-b92e-dcb4454889d1 could not be found. Aug 27 02:27:21.198883 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:27:21.198883 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:27:21.198883 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:27:21.198883 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:21.198883 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:27:21.198883 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:27:21.198883 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:27:21.198883 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:27:21.198883 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:27:21.200250 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:27:21.200250 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:27:21.200250 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:27:21.200250 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:27:21.200250 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:27:21.200250 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:27:21.200250 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:27:21.200250 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fedf0d1-cc1c-4947-b92e-dcb4454889d1 could not be found. Aug 27 02:27:21.200250 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:27:21.200250 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:27:21.200250 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:27:21.200250 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:21.200250 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:27:21.200250 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:27:21.200250 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:27:21.200250 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:27:21.200250 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fedf0d1-cc1c-4947-b92e-dcb4454889d1 could not be found. Aug 27 02:27:21.200250 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:27:21.201575 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-2018ff15-e52d-4684-bd33-be420094611e tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] Returning 404 to user: Instance 4fedf0d1-cc1c-4947-b92e-dcb4454889d1 could not be found. {{(pid=120782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:27:21.201575 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-2018ff15-e52d-4684-bd33-be420094611e tempest-AttachVolumeTestJSON-1060962345 tempest-AttachVolumeTestJSON-1060962345-project] 10.222.0.61 "GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1" status: 404 len: 111 microversion: 2.1 time: 0.059227 Aug 27 02:27:21.202066 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 489/956] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:21 2022] GET /compute/v2.1/servers/4fedf0d1-cc1c-4947-b92e-dcb4454889d1 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:27:21.206998 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-327fe048-3643-4646-abb2-07e0679cb4b4 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:21.207604 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-327fe048-3643-4646-abb2-07e0679cb4b4 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 99f2f366-4776-427e-99cf-79399835f2c8] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:21.213517 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-0f41c96d-8ae0-4ea2-85d1-68ca25f84585 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f53d57f3544e5a25e1beeddab9af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2d4ae1c228446eb5bfc64d44348fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:21.216376 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-327fe048-3643-4646-abb2-07e0679cb4b4 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:21.216806 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-327fe048-3643-4646-abb2-07e0679cb4b4 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:21.217233 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-327fe048-3643-4646-abb2-07e0679cb4b4 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:21.217989 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-327fe048-3643-4646-abb2-07e0679cb4b4 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:21.218431 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-327fe048-3643-4646-abb2-07e0679cb4b4 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:21.218854 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-327fe048-3643-4646-abb2-07e0679cb4b4 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:21.242599 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-0f41c96d-8ae0-4ea2-85d1-68ca25f84585 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] 10.222.0.61 "GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3" status: 200 len: 1577 microversion: 2.1 time: 0.234952 Aug 27 02:27:21.243400 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 468/957] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:21 2022] GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3 => generated 1577 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:21.430902 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-327fe048-3643-4646-abb2-07e0679cb4b4 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:21.440405 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-327fe048-3643-4646-abb2-07e0679cb4b4 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:21.442728 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-327fe048-3643-4646-abb2-07e0679cb4b4 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:21.444522 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-327fe048-3643-4646-abb2-07e0679cb4b4 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8" status: 200 len: 1729 microversion: 2.20 time: 0.241436 Aug 27 02:27:21.445325 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 490/958] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:27:21 2022] GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8 => generated 1729 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:27:21.637869 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [req-9192896b-ad33-4041-9ed0-55c756c05d19 req-27facfea-f519-4ecf-93dd-6722dd352660 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fb59350-4f09-4e20-bddb-ffc9a65897b3", "name": "network-vif-plugged", "status": "completed", "tag": "b6386749-9042-42f7-933e-fe24b60012ef"}]} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:27:21.655461 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-9192896b-ad33-4041-9ed0-55c756c05d19 req-27facfea-f519-4ecf-93dd-6722dd352660 service nova] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:21.659557 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-9192896b-ad33-4041-9ed0-55c756c05d19 req-27facfea-f519-4ecf-93dd-6722dd352660 service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:21.660909 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-9192896b-ad33-4041-9ed0-55c756c05d19 req-27facfea-f519-4ecf-93dd-6722dd352660 service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:21.690727 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.compute.server_external_events [req-9192896b-ad33-4041-9ed0-55c756c05d19 req-27facfea-f519-4ecf-93dd-6722dd352660 service nova] Creating event network-vif-plugged:b6386749-9042-42f7-933e-fe24b60012ef for instance 9fb59350-4f09-4e20-bddb-ffc9a65897b3 on hv-cinder-84630 Aug 27 02:27:21.703004 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [req-9192896b-ad33-4041-9ed0-55c756c05d19 req-27facfea-f519-4ecf-93dd-6722dd352660 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069903 Aug 27 02:27:21.707775 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 469/959] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Aug 27 02:27:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:27:21.736322 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-96962da3-ea76-41f2-ac4f-75b29e041797 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:21.736877 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-96962da3-ea76-41f2-ac4f-75b29e041797 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: a279a105-ed85-45eb-9725-366e0cceb6d6] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:21.748651 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-96962da3-ea76-41f2-ac4f-75b29e041797 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:21.749162 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-96962da3-ea76-41f2-ac4f-75b29e041797 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:21.749629 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-96962da3-ea76-41f2-ac4f-75b29e041797 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:21.750374 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-96962da3-ea76-41f2-ac4f-75b29e041797 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:21.750905 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-96962da3-ea76-41f2-ac4f-75b29e041797 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:21.751298 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-96962da3-ea76-41f2-ac4f-75b29e041797 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:21.777778 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.wsgi [None req-96962da3-ea76-41f2-ac4f-75b29e041797 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] HTTP exception thrown: Instance a279a105-ed85-45eb-9725-366e0cceb6d6 could not be found. Aug 27 02:27:21.779812 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-96962da3-ea76-41f2-ac4f-75b29e041797 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Request method failure captured: Aug 27 02:27:21.779812 dv-cinder-846303-3-smb devstack@n-api.service[120782]: request: DELETE /compute/v2.1/servers/a279a105-ed85-45eb-9725-366e0cceb6d6 HTTP/1.1 Aug 27 02:27:21.779812 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Accept: application/json Aug 27 02:27:21.779812 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Accept-Encoding: identity Aug 27 02:27:21.779812 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Connection: close Aug 27 02:27:21.779812 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Content-Length: 0 Aug 27 02:27:21.779812 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Content-Type: application/json Aug 27 02:27:21.779812 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Host: 10.222.0.61 Aug 27 02:27:21.779812 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Openstack-System-Scope: None Aug 27 02:27:21.779812 dv-cinder-846303-3-smb devstack@n-api.service[120782]: User-Agent: python-urllib3/1.26.11 Aug 27 02:27:21.779812 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Auth-Token: gAAAAABjCX-GZMxBoDm0UEKrtF9w1zn8zf5k_pRKs9w1w8QBRmamyePi9gdcvRwYzK044f89BKz1wZ6FALfNLv1C6uDnz_VZDZcPY_z2HcyDI5nmMGMvL5rG2v4zh3O1IrszVG_kNPPcMoviX7QaOQhXuRqD1X6DsEJwS6gyWrQ-SPSaYeWVQOw Aug 27 02:27:21.779812 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Domain-Id: None Aug 27 02:27:21.779812 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Domain-Name: None Aug 27 02:27:21.779812 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Identity-Status: Confirmed Aug 27 02:27:21.779812 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Is-Admin-Project: True Aug 27 02:27:21.779812 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Domain-Id: default Aug 27 02:27:21.779812 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Domain-Name: Default Aug 27 02:27:21.779812 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Id: 8aa1c411b57d4e72885dac2b4f4dfe7a Aug 27 02:27:21.779812 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Name: tempest-AttachVolumeNegativeTest-799378516 Aug 27 02:27:21.779812 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Role: member,reader Aug 27 02:27:21.779812 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Roles: member,reader Aug 27 02:27:21.781562 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/8aa1c411b57d4e72885dac2b4f4dfe7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_8aa1c411b57d4e72885dac2b4f4dfe7a", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8aa1c411b57d4e72885dac2b4f4dfe7a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8aa1c411b57d4e72885dac2b4f4dfe7a"}]}] Aug 27 02:27:21.781562 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Tenant: tempest-AttachVolumeNegativeTest-799378516 Aug 27 02:27:21.781562 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Tenant-Id: 8aa1c411b57d4e72885dac2b4f4dfe7a Aug 27 02:27:21.781562 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-799378516 Aug 27 02:27:21.781562 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User: tempest-AttachVolumeNegativeTest-799378516-project Aug 27 02:27:21.781562 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Domain-Id: default Aug 27 02:27:21.781562 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Domain-Name: Default Aug 27 02:27:21.781562 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Id: 4a6f819365574091ae344f14e47f487f Aug 27 02:27:21.781562 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Name: tempest-AttachVolumeNegativeTest-799378516-project Aug 27 02:27:21.781562 dv-cinder-846303-3-smb devstack@n-api.service[120782]: method: > Aug 27 02:27:21.781562 dv-cinder-846303-3-smb devstack@n-api.service[120782]: exception: Instance a279a105-ed85-45eb-9725-366e0cceb6d6 could not be found. Aug 27 02:27:21.781562 dv-cinder-846303-3-smb devstack@n-api.service[120782]: action_args: {'id': 'a279a105-ed85-45eb-9725-366e0cceb6d6'} Aug 27 02:27:21.782470 dv-cinder-846303-3-smb devstack@n-api.service[120782]: {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:27:21.782470 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:21.782470 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:27:21.782470 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:27:21.782470 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:27:21.782470 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:27:21.782470 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:27:21.782470 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:27:21.782470 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:27:21.782470 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:27:21.782470 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a279a105-ed85-45eb-9725-366e0cceb6d6 could not be found. Aug 27 02:27:21.782470 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:27:21.782470 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:27:21.782470 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:27:21.782470 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:21.782470 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:27:21.782470 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:27:21.782470 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:27:21.782470 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:27:21.782470 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:27:21.783818 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:27:21.783818 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 02:27:21.783818 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 02:27:21.783818 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 02:27:21.783818 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 02:27:21.783818 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:27:21.783818 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:27:21.783818 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:27:21.783818 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:27:21.783818 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a279a105-ed85-45eb-9725-366e0cceb6d6 could not be found. Aug 27 02:27:21.783818 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:27:21.783818 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:27:21.783818 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:27:21.783818 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:21.783818 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:27:21.783818 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:27:21.783818 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:27:21.783818 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:27:21.783818 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a279a105-ed85-45eb-9725-366e0cceb6d6 could not be found. Aug 27 02:27:21.783818 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:27:21.785943 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-96962da3-ea76-41f2-ac4f-75b29e041797 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Returning 404 to user: Instance a279a105-ed85-45eb-9725-366e0cceb6d6 could not be found. {{(pid=120782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:27:21.786973 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-96962da3-ea76-41f2-ac4f-75b29e041797 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "DELETE /compute/v2.1/servers/a279a105-ed85-45eb-9725-366e0cceb6d6" status: 404 len: 111 microversion: 2.1 time: 0.054962 Aug 27 02:27:21.788009 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 491/960] 10.222.0.61 () {58 vars in 1239 bytes} [Sat Aug 27 02:27:21 2022] DELETE /compute/v2.1/servers/a279a105-ed85-45eb-9725-366e0cceb6d6 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:27:21.796772 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-e43ba154-ea5b-4c0c-9b39-d1ebc01969d5 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:21.797488 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-e43ba154-ea5b-4c0c-9b39-d1ebc01969d5 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: a279a105-ed85-45eb-9725-366e0cceb6d6] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:21.804799 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e43ba154-ea5b-4c0c-9b39-d1ebc01969d5 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:21.810961 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e43ba154-ea5b-4c0c-9b39-d1ebc01969d5 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:21.811850 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e43ba154-ea5b-4c0c-9b39-d1ebc01969d5 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:21.812762 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e43ba154-ea5b-4c0c-9b39-d1ebc01969d5 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:21.813376 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e43ba154-ea5b-4c0c-9b39-d1ebc01969d5 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:21.818939 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e43ba154-ea5b-4c0c-9b39-d1ebc01969d5 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:21.840073 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.wsgi [None req-e43ba154-ea5b-4c0c-9b39-d1ebc01969d5 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] HTTP exception thrown: Instance a279a105-ed85-45eb-9725-366e0cceb6d6 could not be found. Aug 27 02:27:21.852407 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-e43ba154-ea5b-4c0c-9b39-d1ebc01969d5 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Request method failure captured: Aug 27 02:27:21.852407 dv-cinder-846303-3-smb devstack@n-api.service[120783]: request: GET /compute/v2.1/servers/a279a105-ed85-45eb-9725-366e0cceb6d6 HTTP/1.1 Aug 27 02:27:21.852407 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Accept: application/json Aug 27 02:27:21.852407 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Accept-Encoding: identity Aug 27 02:27:21.852407 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Connection: close Aug 27 02:27:21.852407 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Content-Length: 0 Aug 27 02:27:21.852407 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Content-Type: application/json Aug 27 02:27:21.852407 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Host: 10.222.0.61 Aug 27 02:27:21.852407 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Openstack-System-Scope: None Aug 27 02:27:21.852407 dv-cinder-846303-3-smb devstack@n-api.service[120783]: User-Agent: python-urllib3/1.26.11 Aug 27 02:27:21.852407 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Auth-Token: gAAAAABjCX-GZMxBoDm0UEKrtF9w1zn8zf5k_pRKs9w1w8QBRmamyePi9gdcvRwYzK044f89BKz1wZ6FALfNLv1C6uDnz_VZDZcPY_z2HcyDI5nmMGMvL5rG2v4zh3O1IrszVG_kNPPcMoviX7QaOQhXuRqD1X6DsEJwS6gyWrQ-SPSaYeWVQOw Aug 27 02:27:21.852407 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Domain-Id: None Aug 27 02:27:21.852407 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Domain-Name: None Aug 27 02:27:21.852407 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Identity-Status: Confirmed Aug 27 02:27:21.852407 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Is-Admin-Project: True Aug 27 02:27:21.852407 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Project-Domain-Id: default Aug 27 02:27:21.852407 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Project-Domain-Name: Default Aug 27 02:27:21.852407 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Project-Id: 8aa1c411b57d4e72885dac2b4f4dfe7a Aug 27 02:27:21.852407 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Project-Name: tempest-AttachVolumeNegativeTest-799378516 Aug 27 02:27:21.852407 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Role: member,reader Aug 27 02:27:21.852407 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Roles: member,reader Aug 27 02:27:21.854132 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/8aa1c411b57d4e72885dac2b4f4dfe7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_8aa1c411b57d4e72885dac2b4f4dfe7a", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8aa1c411b57d4e72885dac2b4f4dfe7a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8aa1c411b57d4e72885dac2b4f4dfe7a"}]}] Aug 27 02:27:21.854132 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Tenant: tempest-AttachVolumeNegativeTest-799378516 Aug 27 02:27:21.854132 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Tenant-Id: 8aa1c411b57d4e72885dac2b4f4dfe7a Aug 27 02:27:21.854132 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-799378516 Aug 27 02:27:21.854132 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User: tempest-AttachVolumeNegativeTest-799378516-project Aug 27 02:27:21.854132 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User-Domain-Id: default Aug 27 02:27:21.854132 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User-Domain-Name: Default Aug 27 02:27:21.854132 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User-Id: 4a6f819365574091ae344f14e47f487f Aug 27 02:27:21.854132 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User-Name: tempest-AttachVolumeNegativeTest-799378516-project Aug 27 02:27:21.854132 dv-cinder-846303-3-smb devstack@n-api.service[120783]: method: > Aug 27 02:27:21.854132 dv-cinder-846303-3-smb devstack@n-api.service[120783]: exception: Instance a279a105-ed85-45eb-9725-366e0cceb6d6 could not be found. Aug 27 02:27:21.854132 dv-cinder-846303-3-smb devstack@n-api.service[120783]: action_args: {'id': 'a279a105-ed85-45eb-9725-366e0cceb6d6'} Aug 27 02:27:21.855042 dv-cinder-846303-3-smb devstack@n-api.service[120783]: {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:27:21.855042 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:21.855042 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:27:21.855042 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:27:21.855042 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:27:21.855042 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:27:21.855042 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:27:21.855042 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:27:21.855042 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:27:21.855042 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:27:21.855042 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a279a105-ed85-45eb-9725-366e0cceb6d6 could not be found. Aug 27 02:27:21.855042 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:27:21.855042 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:27:21.855042 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:27:21.855042 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:21.855042 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:27:21.855042 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:27:21.855042 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:27:21.855042 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:27:21.855042 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:27:21.856555 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:27:21.856555 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:27:21.856555 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:27:21.856555 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:27:21.856555 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:27:21.856555 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:27:21.856555 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:27:21.856555 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a279a105-ed85-45eb-9725-366e0cceb6d6 could not be found. Aug 27 02:27:21.856555 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:27:21.856555 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:27:21.856555 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:27:21.856555 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:21.856555 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:27:21.856555 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:27:21.856555 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:27:21.856555 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:27:21.856555 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a279a105-ed85-45eb-9725-366e0cceb6d6 could not be found. Aug 27 02:27:21.856555 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:27:21.858690 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-e43ba154-ea5b-4c0c-9b39-d1ebc01969d5 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Returning 404 to user: Instance a279a105-ed85-45eb-9725-366e0cceb6d6 could not be found. {{(pid=120783) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:27:21.859736 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-e43ba154-ea5b-4c0c-9b39-d1ebc01969d5 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/a279a105-ed85-45eb-9725-366e0cceb6d6" status: 404 len: 111 microversion: 2.1 time: 0.067236 Aug 27 02:27:21.860818 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 470/961] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:21 2022] GET /compute/v2.1/servers/a279a105-ed85-45eb-9725-366e0cceb6d6 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:27:22.264997 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-641059bc-03e4-4665-ae6f-1304baedf62a tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:22.265631 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-641059bc-03e4-4665-ae6f-1304baedf62a tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] [instance: 9fb59350-4f09-4e20-bddb-ffc9a65897b3] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:22.289077 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-641059bc-03e4-4665-ae6f-1304baedf62a tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:22.289598 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-641059bc-03e4-4665-ae6f-1304baedf62a tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:22.290027 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-641059bc-03e4-4665-ae6f-1304baedf62a tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:22.290807 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-641059bc-03e4-4665-ae6f-1304baedf62a tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:22.291266 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-641059bc-03e4-4665-ae6f-1304baedf62a tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:22.291672 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-641059bc-03e4-4665-ae6f-1304baedf62a tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:22.469105 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-4c64d594-8f48-4c29-8902-d87d096c691c tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:22.469907 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-4c64d594-8f48-4c29-8902-d87d096c691c tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 99f2f366-4776-427e-99cf-79399835f2c8] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:22.479644 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4c64d594-8f48-4c29-8902-d87d096c691c tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:22.480483 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4c64d594-8f48-4c29-8902-d87d096c691c tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:22.481710 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4c64d594-8f48-4c29-8902-d87d096c691c tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:22.494509 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4c64d594-8f48-4c29-8902-d87d096c691c tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:22.495397 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4c64d594-8f48-4c29-8902-d87d096c691c tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:22.496051 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4c64d594-8f48-4c29-8902-d87d096c691c tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:22.613028 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-641059bc-03e4-4665-ae6f-1304baedf62a tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f53d57f3544e5a25e1beeddab9af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2d4ae1c228446eb5bfc64d44348fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:22.625972 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-641059bc-03e4-4665-ae6f-1304baedf62a tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] 10.222.0.61 "GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3" status: 200 len: 1577 microversion: 2.1 time: 0.365126 Aug 27 02:27:22.641481 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 492/962] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:22 2022] GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3 => generated 1577 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:22.792512 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-4c64d594-8f48-4c29-8902-d87d096c691c tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:22.802738 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-4c64d594-8f48-4c29-8902-d87d096c691c tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:22.804194 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-4c64d594-8f48-4c29-8902-d87d096c691c tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:22.805490 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-4c64d594-8f48-4c29-8902-d87d096c691c tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8" status: 200 len: 1729 microversion: 2.20 time: 0.341245 Aug 27 02:27:22.806469 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 471/963] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:27:22 2022] GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8 => generated 1729 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:27:23.160292 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-ddbe4529-8fad-4638-bb5a-b5a3ce8f0897 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:23.160803 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-ddbe4529-8fad-4638-bb5a-b5a3ce8f0897 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: 77c3697a-5b72-4f66-9ba0-0fba67484286] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:23.170815 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ddbe4529-8fad-4638-bb5a-b5a3ce8f0897 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:23.171301 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ddbe4529-8fad-4638-bb5a-b5a3ce8f0897 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:23.171753 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ddbe4529-8fad-4638-bb5a-b5a3ce8f0897 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:23.172505 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ddbe4529-8fad-4638-bb5a-b5a3ce8f0897 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:23.172970 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ddbe4529-8fad-4638-bb5a-b5a3ce8f0897 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:23.173416 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ddbe4529-8fad-4638-bb5a-b5a3ce8f0897 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:23.210996 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.wsgi [None req-ddbe4529-8fad-4638-bb5a-b5a3ce8f0897 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] HTTP exception thrown: Instance 77c3697a-5b72-4f66-9ba0-0fba67484286 could not be found. Aug 27 02:27:23.212621 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-ddbe4529-8fad-4638-bb5a-b5a3ce8f0897 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Request method failure captured: Aug 27 02:27:23.212621 dv-cinder-846303-3-smb devstack@n-api.service[120782]: request: DELETE /compute/v2.1/servers/77c3697a-5b72-4f66-9ba0-0fba67484286 HTTP/1.1 Aug 27 02:27:23.212621 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Accept: application/json Aug 27 02:27:23.212621 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Accept-Encoding: identity Aug 27 02:27:23.212621 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Connection: close Aug 27 02:27:23.212621 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Content-Length: 0 Aug 27 02:27:23.212621 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Content-Type: application/json Aug 27 02:27:23.212621 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Host: 10.222.0.61 Aug 27 02:27:23.212621 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Openstack-System-Scope: None Aug 27 02:27:23.212621 dv-cinder-846303-3-smb devstack@n-api.service[120782]: User-Agent: python-urllib3/1.26.11 Aug 27 02:27:23.212621 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Auth-Token: gAAAAABjCX-GZMxBoDm0UEKrtF9w1zn8zf5k_pRKs9w1w8QBRmamyePi9gdcvRwYzK044f89BKz1wZ6FALfNLv1C6uDnz_VZDZcPY_z2HcyDI5nmMGMvL5rG2v4zh3O1IrszVG_kNPPcMoviX7QaOQhXuRqD1X6DsEJwS6gyWrQ-SPSaYeWVQOw Aug 27 02:27:23.212621 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Domain-Id: None Aug 27 02:27:23.212621 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Domain-Name: None Aug 27 02:27:23.212621 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Identity-Status: Confirmed Aug 27 02:27:23.212621 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Is-Admin-Project: True Aug 27 02:27:23.212621 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Domain-Id: default Aug 27 02:27:23.212621 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Domain-Name: Default Aug 27 02:27:23.212621 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Id: 8aa1c411b57d4e72885dac2b4f4dfe7a Aug 27 02:27:23.212621 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Name: tempest-AttachVolumeNegativeTest-799378516 Aug 27 02:27:23.212621 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Role: member,reader Aug 27 02:27:23.212621 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Roles: member,reader Aug 27 02:27:23.214269 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/8aa1c411b57d4e72885dac2b4f4dfe7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_8aa1c411b57d4e72885dac2b4f4dfe7a", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8aa1c411b57d4e72885dac2b4f4dfe7a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8aa1c411b57d4e72885dac2b4f4dfe7a"}]}] Aug 27 02:27:23.214269 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Tenant: tempest-AttachVolumeNegativeTest-799378516 Aug 27 02:27:23.214269 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Tenant-Id: 8aa1c411b57d4e72885dac2b4f4dfe7a Aug 27 02:27:23.214269 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-799378516 Aug 27 02:27:23.214269 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User: tempest-AttachVolumeNegativeTest-799378516-project Aug 27 02:27:23.214269 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Domain-Id: default Aug 27 02:27:23.214269 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Domain-Name: Default Aug 27 02:27:23.214269 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Id: 4a6f819365574091ae344f14e47f487f Aug 27 02:27:23.214269 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Name: tempest-AttachVolumeNegativeTest-799378516-project Aug 27 02:27:23.214269 dv-cinder-846303-3-smb devstack@n-api.service[120782]: method: > Aug 27 02:27:23.214269 dv-cinder-846303-3-smb devstack@n-api.service[120782]: exception: Instance 77c3697a-5b72-4f66-9ba0-0fba67484286 could not be found. Aug 27 02:27:23.214269 dv-cinder-846303-3-smb devstack@n-api.service[120782]: action_args: {'id': '77c3697a-5b72-4f66-9ba0-0fba67484286'} Aug 27 02:27:23.215083 dv-cinder-846303-3-smb devstack@n-api.service[120782]: {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:27:23.215083 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:23.215083 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:27:23.215083 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:27:23.215083 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:27:23.215083 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:27:23.215083 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:27:23.215083 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:27:23.215083 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:27:23.215083 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:27:23.215083 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77c3697a-5b72-4f66-9ba0-0fba67484286 could not be found. Aug 27 02:27:23.215083 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:27:23.215083 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:27:23.215083 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:27:23.215083 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:23.215083 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:27:23.215083 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:27:23.215083 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:27:23.215083 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:27:23.215083 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:27:23.216433 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:27:23.216433 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 02:27:23.216433 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 02:27:23.216433 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 02:27:23.216433 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 02:27:23.216433 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:27:23.216433 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:27:23.216433 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:27:23.216433 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:27:23.216433 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77c3697a-5b72-4f66-9ba0-0fba67484286 could not be found. Aug 27 02:27:23.216433 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:27:23.216433 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:27:23.216433 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:27:23.216433 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:23.216433 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:27:23.216433 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:27:23.216433 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:27:23.216433 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:27:23.216433 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77c3697a-5b72-4f66-9ba0-0fba67484286 could not be found. Aug 27 02:27:23.216433 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:27:23.222188 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-ddbe4529-8fad-4638-bb5a-b5a3ce8f0897 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Returning 404 to user: Instance 77c3697a-5b72-4f66-9ba0-0fba67484286 could not be found. {{(pid=120782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:27:23.222188 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-ddbe4529-8fad-4638-bb5a-b5a3ce8f0897 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "DELETE /compute/v2.1/servers/77c3697a-5b72-4f66-9ba0-0fba67484286" status: 404 len: 111 microversion: 2.1 time: 0.061641 Aug 27 02:27:23.222188 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 493/964] 10.222.0.61 () {58 vars in 1239 bytes} [Sat Aug 27 02:27:23 2022] DELETE /compute/v2.1/servers/77c3697a-5b72-4f66-9ba0-0fba67484286 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:27:23.227131 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-f2932137-c757-4a5d-ab13-4bafb99971ed tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:23.228040 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-f2932137-c757-4a5d-ab13-4bafb99971ed tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: 77c3697a-5b72-4f66-9ba0-0fba67484286] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:23.258816 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f2932137-c757-4a5d-ab13-4bafb99971ed tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:23.259318 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f2932137-c757-4a5d-ab13-4bafb99971ed tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:23.259757 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f2932137-c757-4a5d-ab13-4bafb99971ed tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:23.260499 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f2932137-c757-4a5d-ab13-4bafb99971ed tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:23.260987 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f2932137-c757-4a5d-ab13-4bafb99971ed tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:23.261459 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f2932137-c757-4a5d-ab13-4bafb99971ed tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:23.293126 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.wsgi [None req-f2932137-c757-4a5d-ab13-4bafb99971ed tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] HTTP exception thrown: Instance 77c3697a-5b72-4f66-9ba0-0fba67484286 could not be found. Aug 27 02:27:23.295696 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-f2932137-c757-4a5d-ab13-4bafb99971ed tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Request method failure captured: Aug 27 02:27:23.295696 dv-cinder-846303-3-smb devstack@n-api.service[120783]: request: GET /compute/v2.1/servers/77c3697a-5b72-4f66-9ba0-0fba67484286 HTTP/1.1 Aug 27 02:27:23.295696 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Accept: application/json Aug 27 02:27:23.295696 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Accept-Encoding: identity Aug 27 02:27:23.295696 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Connection: close Aug 27 02:27:23.295696 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Content-Length: 0 Aug 27 02:27:23.295696 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Content-Type: application/json Aug 27 02:27:23.295696 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Host: 10.222.0.61 Aug 27 02:27:23.295696 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Openstack-System-Scope: None Aug 27 02:27:23.295696 dv-cinder-846303-3-smb devstack@n-api.service[120783]: User-Agent: python-urllib3/1.26.11 Aug 27 02:27:23.295696 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Auth-Token: gAAAAABjCX-GZMxBoDm0UEKrtF9w1zn8zf5k_pRKs9w1w8QBRmamyePi9gdcvRwYzK044f89BKz1wZ6FALfNLv1C6uDnz_VZDZcPY_z2HcyDI5nmMGMvL5rG2v4zh3O1IrszVG_kNPPcMoviX7QaOQhXuRqD1X6DsEJwS6gyWrQ-SPSaYeWVQOw Aug 27 02:27:23.295696 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Domain-Id: None Aug 27 02:27:23.295696 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Domain-Name: None Aug 27 02:27:23.295696 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Identity-Status: Confirmed Aug 27 02:27:23.295696 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Is-Admin-Project: True Aug 27 02:27:23.295696 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Project-Domain-Id: default Aug 27 02:27:23.295696 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Project-Domain-Name: Default Aug 27 02:27:23.295696 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Project-Id: 8aa1c411b57d4e72885dac2b4f4dfe7a Aug 27 02:27:23.295696 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Project-Name: tempest-AttachVolumeNegativeTest-799378516 Aug 27 02:27:23.295696 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Role: member,reader Aug 27 02:27:23.295696 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Roles: member,reader Aug 27 02:27:23.297451 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/8aa1c411b57d4e72885dac2b4f4dfe7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_8aa1c411b57d4e72885dac2b4f4dfe7a", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8aa1c411b57d4e72885dac2b4f4dfe7a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8aa1c411b57d4e72885dac2b4f4dfe7a"}]}] Aug 27 02:27:23.297451 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Tenant: tempest-AttachVolumeNegativeTest-799378516 Aug 27 02:27:23.297451 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Tenant-Id: 8aa1c411b57d4e72885dac2b4f4dfe7a Aug 27 02:27:23.297451 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-799378516 Aug 27 02:27:23.297451 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User: tempest-AttachVolumeNegativeTest-799378516-project Aug 27 02:27:23.297451 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User-Domain-Id: default Aug 27 02:27:23.297451 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User-Domain-Name: Default Aug 27 02:27:23.297451 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User-Id: 4a6f819365574091ae344f14e47f487f Aug 27 02:27:23.297451 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User-Name: tempest-AttachVolumeNegativeTest-799378516-project Aug 27 02:27:23.297451 dv-cinder-846303-3-smb devstack@n-api.service[120783]: method: > Aug 27 02:27:23.297451 dv-cinder-846303-3-smb devstack@n-api.service[120783]: exception: Instance 77c3697a-5b72-4f66-9ba0-0fba67484286 could not be found. Aug 27 02:27:23.297451 dv-cinder-846303-3-smb devstack@n-api.service[120783]: action_args: {'id': '77c3697a-5b72-4f66-9ba0-0fba67484286'} Aug 27 02:27:23.298578 dv-cinder-846303-3-smb devstack@n-api.service[120783]: {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:27:23.298578 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:23.298578 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:27:23.298578 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:27:23.298578 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:27:23.298578 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:27:23.298578 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:27:23.298578 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:27:23.298578 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:27:23.298578 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:27:23.298578 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77c3697a-5b72-4f66-9ba0-0fba67484286 could not be found. Aug 27 02:27:23.298578 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:27:23.298578 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:27:23.298578 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:27:23.298578 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:23.298578 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:27:23.298578 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:27:23.298578 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:27:23.298578 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:27:23.298578 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:27:23.300031 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:27:23.300031 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:27:23.300031 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:27:23.300031 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:27:23.300031 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:27:23.300031 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:27:23.300031 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:27:23.300031 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77c3697a-5b72-4f66-9ba0-0fba67484286 could not be found. Aug 27 02:27:23.300031 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:27:23.300031 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:27:23.300031 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:27:23.300031 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:23.300031 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:27:23.300031 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:27:23.300031 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:27:23.300031 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:27:23.300031 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77c3697a-5b72-4f66-9ba0-0fba67484286 could not be found. Aug 27 02:27:23.300031 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:27:23.324427 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-f2932137-c757-4a5d-ab13-4bafb99971ed tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Returning 404 to user: Instance 77c3697a-5b72-4f66-9ba0-0fba67484286 could not be found. {{(pid=120783) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:27:23.325734 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-f2932137-c757-4a5d-ab13-4bafb99971ed tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/77c3697a-5b72-4f66-9ba0-0fba67484286" status: 404 len: 111 microversion: 2.1 time: 0.103524 Aug 27 02:27:23.326314 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 472/965] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:23 2022] GET /compute/v2.1/servers/77c3697a-5b72-4f66-9ba0-0fba67484286 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:27:23.337285 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-9fca3c81-5561-4425-a469-b3062f7631d7 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:23.337868 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-9fca3c81-5561-4425-a469-b3062f7631d7 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: d5c72277-dabd-484c-9e20-279b6159516a] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:23.361092 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9fca3c81-5561-4425-a469-b3062f7631d7 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:23.362089 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9fca3c81-5561-4425-a469-b3062f7631d7 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:23.362843 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9fca3c81-5561-4425-a469-b3062f7631d7 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:23.363936 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9fca3c81-5561-4425-a469-b3062f7631d7 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:23.364935 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9fca3c81-5561-4425-a469-b3062f7631d7 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:23.365841 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9fca3c81-5561-4425-a469-b3062f7631d7 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:23.411894 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.wsgi [None req-9fca3c81-5561-4425-a469-b3062f7631d7 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] HTTP exception thrown: Instance d5c72277-dabd-484c-9e20-279b6159516a could not be found. Aug 27 02:27:23.418507 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-9fca3c81-5561-4425-a469-b3062f7631d7 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Request method failure captured: Aug 27 02:27:23.418507 dv-cinder-846303-3-smb devstack@n-api.service[120782]: request: DELETE /compute/v2.1/servers/d5c72277-dabd-484c-9e20-279b6159516a HTTP/1.1 Aug 27 02:27:23.418507 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Accept: application/json Aug 27 02:27:23.418507 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Accept-Encoding: identity Aug 27 02:27:23.418507 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Connection: close Aug 27 02:27:23.418507 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Content-Length: 0 Aug 27 02:27:23.418507 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Content-Type: application/json Aug 27 02:27:23.418507 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Host: 10.222.0.61 Aug 27 02:27:23.418507 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Openstack-System-Scope: None Aug 27 02:27:23.418507 dv-cinder-846303-3-smb devstack@n-api.service[120782]: User-Agent: python-urllib3/1.26.11 Aug 27 02:27:23.418507 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Auth-Token: gAAAAABjCX-GZMxBoDm0UEKrtF9w1zn8zf5k_pRKs9w1w8QBRmamyePi9gdcvRwYzK044f89BKz1wZ6FALfNLv1C6uDnz_VZDZcPY_z2HcyDI5nmMGMvL5rG2v4zh3O1IrszVG_kNPPcMoviX7QaOQhXuRqD1X6DsEJwS6gyWrQ-SPSaYeWVQOw Aug 27 02:27:23.418507 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Domain-Id: None Aug 27 02:27:23.418507 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Domain-Name: None Aug 27 02:27:23.418507 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Identity-Status: Confirmed Aug 27 02:27:23.418507 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Is-Admin-Project: True Aug 27 02:27:23.418507 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Domain-Id: default Aug 27 02:27:23.418507 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Domain-Name: Default Aug 27 02:27:23.418507 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Id: 8aa1c411b57d4e72885dac2b4f4dfe7a Aug 27 02:27:23.418507 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Name: tempest-AttachVolumeNegativeTest-799378516 Aug 27 02:27:23.418507 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Role: member,reader Aug 27 02:27:23.418507 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Roles: member,reader Aug 27 02:27:23.420235 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/8aa1c411b57d4e72885dac2b4f4dfe7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_8aa1c411b57d4e72885dac2b4f4dfe7a", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8aa1c411b57d4e72885dac2b4f4dfe7a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8aa1c411b57d4e72885dac2b4f4dfe7a"}]}] Aug 27 02:27:23.420235 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Tenant: tempest-AttachVolumeNegativeTest-799378516 Aug 27 02:27:23.420235 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Tenant-Id: 8aa1c411b57d4e72885dac2b4f4dfe7a Aug 27 02:27:23.420235 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-799378516 Aug 27 02:27:23.420235 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User: tempest-AttachVolumeNegativeTest-799378516-project Aug 27 02:27:23.420235 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Domain-Id: default Aug 27 02:27:23.420235 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Domain-Name: Default Aug 27 02:27:23.420235 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Id: 4a6f819365574091ae344f14e47f487f Aug 27 02:27:23.420235 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Name: tempest-AttachVolumeNegativeTest-799378516-project Aug 27 02:27:23.420235 dv-cinder-846303-3-smb devstack@n-api.service[120782]: method: > Aug 27 02:27:23.420235 dv-cinder-846303-3-smb devstack@n-api.service[120782]: exception: Instance d5c72277-dabd-484c-9e20-279b6159516a could not be found. Aug 27 02:27:23.420235 dv-cinder-846303-3-smb devstack@n-api.service[120782]: action_args: {'id': 'd5c72277-dabd-484c-9e20-279b6159516a'} Aug 27 02:27:23.421186 dv-cinder-846303-3-smb devstack@n-api.service[120782]: {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:27:23.421186 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:23.421186 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:27:23.421186 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:27:23.421186 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:27:23.421186 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:27:23.421186 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:27:23.421186 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:27:23.421186 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:27:23.421186 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:27:23.421186 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5c72277-dabd-484c-9e20-279b6159516a could not be found. Aug 27 02:27:23.421186 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:27:23.421186 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:27:23.421186 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:27:23.421186 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:23.421186 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:27:23.421186 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:27:23.421186 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:27:23.421186 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:27:23.421186 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:27:23.422671 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:27:23.422671 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 02:27:23.422671 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 02:27:23.422671 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 02:27:23.422671 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 02:27:23.422671 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:27:23.422671 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:27:23.422671 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:27:23.422671 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:27:23.422671 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5c72277-dabd-484c-9e20-279b6159516a could not be found. Aug 27 02:27:23.422671 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:27:23.422671 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:27:23.422671 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:27:23.422671 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:23.422671 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:27:23.422671 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:27:23.422671 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:27:23.422671 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:27:23.422671 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5c72277-dabd-484c-9e20-279b6159516a could not be found. Aug 27 02:27:23.422671 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:27:23.426204 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-9fca3c81-5561-4425-a469-b3062f7631d7 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Returning 404 to user: Instance d5c72277-dabd-484c-9e20-279b6159516a could not be found. {{(pid=120782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:27:23.427318 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-9fca3c81-5561-4425-a469-b3062f7631d7 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "DELETE /compute/v2.1/servers/d5c72277-dabd-484c-9e20-279b6159516a" status: 404 len: 111 microversion: 2.1 time: 0.096209 Aug 27 02:27:23.431630 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 494/966] 10.222.0.61 () {58 vars in 1239 bytes} [Sat Aug 27 02:27:23 2022] DELETE /compute/v2.1/servers/d5c72277-dabd-484c-9e20-279b6159516a => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:27:23.437299 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-fe6d5bce-f194-48fd-b183-7eba14d967ad tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:23.438024 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-fe6d5bce-f194-48fd-b183-7eba14d967ad tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: d5c72277-dabd-484c-9e20-279b6159516a] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:23.455021 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fe6d5bce-f194-48fd-b183-7eba14d967ad tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:23.455661 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fe6d5bce-f194-48fd-b183-7eba14d967ad tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:23.456166 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fe6d5bce-f194-48fd-b183-7eba14d967ad tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:23.457047 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fe6d5bce-f194-48fd-b183-7eba14d967ad tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:23.457652 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fe6d5bce-f194-48fd-b183-7eba14d967ad tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:23.458133 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fe6d5bce-f194-48fd-b183-7eba14d967ad tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:23.478210 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.wsgi [None req-fe6d5bce-f194-48fd-b183-7eba14d967ad tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] HTTP exception thrown: Instance d5c72277-dabd-484c-9e20-279b6159516a could not be found. Aug 27 02:27:23.480078 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-fe6d5bce-f194-48fd-b183-7eba14d967ad tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Request method failure captured: Aug 27 02:27:23.480078 dv-cinder-846303-3-smb devstack@n-api.service[120783]: request: GET /compute/v2.1/servers/d5c72277-dabd-484c-9e20-279b6159516a HTTP/1.1 Aug 27 02:27:23.480078 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Accept: application/json Aug 27 02:27:23.480078 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Accept-Encoding: identity Aug 27 02:27:23.480078 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Connection: close Aug 27 02:27:23.480078 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Content-Length: 0 Aug 27 02:27:23.480078 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Content-Type: application/json Aug 27 02:27:23.480078 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Host: 10.222.0.61 Aug 27 02:27:23.480078 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Openstack-System-Scope: None Aug 27 02:27:23.480078 dv-cinder-846303-3-smb devstack@n-api.service[120783]: User-Agent: python-urllib3/1.26.11 Aug 27 02:27:23.480078 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Auth-Token: gAAAAABjCX-GZMxBoDm0UEKrtF9w1zn8zf5k_pRKs9w1w8QBRmamyePi9gdcvRwYzK044f89BKz1wZ6FALfNLv1C6uDnz_VZDZcPY_z2HcyDI5nmMGMvL5rG2v4zh3O1IrszVG_kNPPcMoviX7QaOQhXuRqD1X6DsEJwS6gyWrQ-SPSaYeWVQOw Aug 27 02:27:23.480078 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Domain-Id: None Aug 27 02:27:23.480078 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Domain-Name: None Aug 27 02:27:23.480078 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Identity-Status: Confirmed Aug 27 02:27:23.480078 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Is-Admin-Project: True Aug 27 02:27:23.480078 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Project-Domain-Id: default Aug 27 02:27:23.480078 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Project-Domain-Name: Default Aug 27 02:27:23.480078 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Project-Id: 8aa1c411b57d4e72885dac2b4f4dfe7a Aug 27 02:27:23.480078 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Project-Name: tempest-AttachVolumeNegativeTest-799378516 Aug 27 02:27:23.480078 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Role: member,reader Aug 27 02:27:23.480078 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Roles: member,reader Aug 27 02:27:23.482220 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/8aa1c411b57d4e72885dac2b4f4dfe7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_8aa1c411b57d4e72885dac2b4f4dfe7a", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8aa1c411b57d4e72885dac2b4f4dfe7a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8aa1c411b57d4e72885dac2b4f4dfe7a"}]}] Aug 27 02:27:23.482220 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Tenant: tempest-AttachVolumeNegativeTest-799378516 Aug 27 02:27:23.482220 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Tenant-Id: 8aa1c411b57d4e72885dac2b4f4dfe7a Aug 27 02:27:23.482220 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-799378516 Aug 27 02:27:23.482220 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User: tempest-AttachVolumeNegativeTest-799378516-project Aug 27 02:27:23.482220 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User-Domain-Id: default Aug 27 02:27:23.482220 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User-Domain-Name: Default Aug 27 02:27:23.482220 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User-Id: 4a6f819365574091ae344f14e47f487f Aug 27 02:27:23.482220 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User-Name: tempest-AttachVolumeNegativeTest-799378516-project Aug 27 02:27:23.482220 dv-cinder-846303-3-smb devstack@n-api.service[120783]: method: > Aug 27 02:27:23.482220 dv-cinder-846303-3-smb devstack@n-api.service[120783]: exception: Instance d5c72277-dabd-484c-9e20-279b6159516a could not be found. Aug 27 02:27:23.482220 dv-cinder-846303-3-smb devstack@n-api.service[120783]: action_args: {'id': 'd5c72277-dabd-484c-9e20-279b6159516a'} Aug 27 02:27:23.483145 dv-cinder-846303-3-smb devstack@n-api.service[120783]: {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:27:23.483145 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:23.483145 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:27:23.483145 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:27:23.483145 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:27:23.483145 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:27:23.483145 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:27:23.483145 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:27:23.483145 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:27:23.483145 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:27:23.483145 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5c72277-dabd-484c-9e20-279b6159516a could not be found. Aug 27 02:27:23.483145 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:27:23.483145 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:27:23.483145 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:27:23.483145 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:23.483145 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:27:23.483145 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:27:23.483145 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:27:23.483145 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:27:23.483145 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:27:23.484605 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:27:23.484605 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:27:23.484605 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:27:23.484605 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:27:23.484605 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:27:23.484605 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:27:23.484605 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:27:23.484605 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5c72277-dabd-484c-9e20-279b6159516a could not be found. Aug 27 02:27:23.484605 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:27:23.484605 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:27:23.484605 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:27:23.484605 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:23.484605 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:27:23.484605 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:27:23.484605 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:27:23.484605 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:27:23.484605 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5c72277-dabd-484c-9e20-279b6159516a could not be found. Aug 27 02:27:23.484605 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:27:23.486712 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-fe6d5bce-f194-48fd-b183-7eba14d967ad tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Returning 404 to user: Instance d5c72277-dabd-484c-9e20-279b6159516a could not be found. {{(pid=120783) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:27:23.486712 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-fe6d5bce-f194-48fd-b183-7eba14d967ad tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/d5c72277-dabd-484c-9e20-279b6159516a" status: 404 len: 111 microversion: 2.1 time: 0.048912 Aug 27 02:27:23.486712 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 473/967] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:23 2022] GET /compute/v2.1/servers/d5c72277-dabd-484c-9e20-279b6159516a => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 02:27:23.650039 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-ba27308d-dfd9-49fc-bd5c-9977a4288b73 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:23.652107 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-ba27308d-dfd9-49fc-bd5c-9977a4288b73 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] [instance: 9fb59350-4f09-4e20-bddb-ffc9a65897b3] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:23.685594 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ba27308d-dfd9-49fc-bd5c-9977a4288b73 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:23.686489 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ba27308d-dfd9-49fc-bd5c-9977a4288b73 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:23.687139 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ba27308d-dfd9-49fc-bd5c-9977a4288b73 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:23.688104 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ba27308d-dfd9-49fc-bd5c-9977a4288b73 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:23.688840 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ba27308d-dfd9-49fc-bd5c-9977a4288b73 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:23.690592 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ba27308d-dfd9-49fc-bd5c-9977a4288b73 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:23.835121 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-2c768ea8-0b85-4569-9cd8-3cdb969a4695 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:23.836145 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-2c768ea8-0b85-4569-9cd8-3cdb969a4695 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 99f2f366-4776-427e-99cf-79399835f2c8] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:23.850449 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2c768ea8-0b85-4569-9cd8-3cdb969a4695 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:23.851115 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2c768ea8-0b85-4569-9cd8-3cdb969a4695 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:23.853057 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2c768ea8-0b85-4569-9cd8-3cdb969a4695 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:23.853920 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2c768ea8-0b85-4569-9cd8-3cdb969a4695 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:23.857892 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2c768ea8-0b85-4569-9cd8-3cdb969a4695 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:23.858468 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2c768ea8-0b85-4569-9cd8-3cdb969a4695 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:24.080234 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-2c768ea8-0b85-4569-9cd8-3cdb969a4695 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:24.091251 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-2c768ea8-0b85-4569-9cd8-3cdb969a4695 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:24.093477 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-2c768ea8-0b85-4569-9cd8-3cdb969a4695 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:24.095713 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-2c768ea8-0b85-4569-9cd8-3cdb969a4695 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8" status: 200 len: 1729 microversion: 2.20 time: 0.265300 Aug 27 02:27:24.109421 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 474/968] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:27:23 2022] GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8 => generated 1729 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:27:24.214400 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-ba27308d-dfd9-49fc-bd5c-9977a4288b73 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f53d57f3544e5a25e1beeddab9af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2d4ae1c228446eb5bfc64d44348fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:24.223800 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-ba27308d-dfd9-49fc-bd5c-9977a4288b73 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] 10.222.0.61 "GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3" status: 200 len: 1577 microversion: 2.1 time: 0.578697 Aug 27 02:27:24.224780 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 495/969] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:23 2022] GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3 => generated 1577 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:24.755434 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-d569a12f-6de0-4498-bd43-b48e7a88512f tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:24.756684 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-d569a12f-6de0-4498-bd43-b48e7a88512f tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: 268d786c-398a-4305-85ac-545fa3b4370b] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:24.764866 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d569a12f-6de0-4498-bd43-b48e7a88512f tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:24.765691 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d569a12f-6de0-4498-bd43-b48e7a88512f tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:24.767291 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d569a12f-6de0-4498-bd43-b48e7a88512f tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:24.768265 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d569a12f-6de0-4498-bd43-b48e7a88512f tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:24.768916 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d569a12f-6de0-4498-bd43-b48e7a88512f tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:24.769715 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d569a12f-6de0-4498-bd43-b48e7a88512f tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:24.815908 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.wsgi [None req-d569a12f-6de0-4498-bd43-b48e7a88512f tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] HTTP exception thrown: Instance 268d786c-398a-4305-85ac-545fa3b4370b could not be found. Aug 27 02:27:24.817388 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-d569a12f-6de0-4498-bd43-b48e7a88512f tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Request method failure captured: Aug 27 02:27:24.817388 dv-cinder-846303-3-smb devstack@n-api.service[120783]: request: DELETE /compute/v2.1/servers/268d786c-398a-4305-85ac-545fa3b4370b HTTP/1.1 Aug 27 02:27:24.817388 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Accept: application/json Aug 27 02:27:24.817388 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Accept-Encoding: identity Aug 27 02:27:24.817388 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Connection: close Aug 27 02:27:24.817388 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Content-Length: 0 Aug 27 02:27:24.817388 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Content-Type: application/json Aug 27 02:27:24.817388 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Host: 10.222.0.61 Aug 27 02:27:24.817388 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Openstack-System-Scope: None Aug 27 02:27:24.817388 dv-cinder-846303-3-smb devstack@n-api.service[120783]: User-Agent: python-urllib3/1.26.11 Aug 27 02:27:24.817388 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Auth-Token: gAAAAABjCX-GZMxBoDm0UEKrtF9w1zn8zf5k_pRKs9w1w8QBRmamyePi9gdcvRwYzK044f89BKz1wZ6FALfNLv1C6uDnz_VZDZcPY_z2HcyDI5nmMGMvL5rG2v4zh3O1IrszVG_kNPPcMoviX7QaOQhXuRqD1X6DsEJwS6gyWrQ-SPSaYeWVQOw Aug 27 02:27:24.817388 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Domain-Id: None Aug 27 02:27:24.817388 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Domain-Name: None Aug 27 02:27:24.817388 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Identity-Status: Confirmed Aug 27 02:27:24.817388 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Is-Admin-Project: True Aug 27 02:27:24.817388 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Project-Domain-Id: default Aug 27 02:27:24.817388 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Project-Domain-Name: Default Aug 27 02:27:24.817388 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Project-Id: 8aa1c411b57d4e72885dac2b4f4dfe7a Aug 27 02:27:24.817388 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Project-Name: tempest-AttachVolumeNegativeTest-799378516 Aug 27 02:27:24.817388 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Role: member,reader Aug 27 02:27:24.817388 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Roles: member,reader Aug 27 02:27:24.819238 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/8aa1c411b57d4e72885dac2b4f4dfe7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_8aa1c411b57d4e72885dac2b4f4dfe7a", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8aa1c411b57d4e72885dac2b4f4dfe7a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8aa1c411b57d4e72885dac2b4f4dfe7a"}]}] Aug 27 02:27:24.819238 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Tenant: tempest-AttachVolumeNegativeTest-799378516 Aug 27 02:27:24.819238 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Tenant-Id: 8aa1c411b57d4e72885dac2b4f4dfe7a Aug 27 02:27:24.819238 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-799378516 Aug 27 02:27:24.819238 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User: tempest-AttachVolumeNegativeTest-799378516-project Aug 27 02:27:24.819238 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User-Domain-Id: default Aug 27 02:27:24.819238 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User-Domain-Name: Default Aug 27 02:27:24.819238 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User-Id: 4a6f819365574091ae344f14e47f487f Aug 27 02:27:24.819238 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User-Name: tempest-AttachVolumeNegativeTest-799378516-project Aug 27 02:27:24.819238 dv-cinder-846303-3-smb devstack@n-api.service[120783]: method: > Aug 27 02:27:24.819238 dv-cinder-846303-3-smb devstack@n-api.service[120783]: exception: Instance 268d786c-398a-4305-85ac-545fa3b4370b could not be found. Aug 27 02:27:24.819238 dv-cinder-846303-3-smb devstack@n-api.service[120783]: action_args: {'id': '268d786c-398a-4305-85ac-545fa3b4370b'} Aug 27 02:27:24.823171 dv-cinder-846303-3-smb devstack@n-api.service[120783]: {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:27:24.823171 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:24.823171 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:27:24.823171 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:27:24.823171 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:27:24.823171 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:27:24.823171 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:27:24.823171 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:27:24.823171 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:27:24.823171 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:27:24.823171 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 268d786c-398a-4305-85ac-545fa3b4370b could not be found. Aug 27 02:27:24.823171 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:27:24.823171 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:27:24.823171 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:27:24.823171 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:24.823171 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:27:24.823171 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:27:24.823171 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:27:24.823171 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:27:24.823171 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:27:24.824667 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:27:24.824667 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 02:27:24.824667 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 02:27:24.824667 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 02:27:24.824667 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 02:27:24.824667 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:27:24.824667 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:27:24.824667 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:27:24.824667 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:27:24.824667 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 268d786c-398a-4305-85ac-545fa3b4370b could not be found. Aug 27 02:27:24.824667 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:27:24.824667 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:27:24.824667 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:27:24.824667 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:24.824667 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:27:24.824667 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:27:24.824667 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:27:24.824667 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:27:24.824667 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 268d786c-398a-4305-85ac-545fa3b4370b could not be found. Aug 27 02:27:24.824667 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:27:24.826227 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-d569a12f-6de0-4498-bd43-b48e7a88512f tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Returning 404 to user: Instance 268d786c-398a-4305-85ac-545fa3b4370b could not be found. {{(pid=120783) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:27:24.826227 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-d569a12f-6de0-4498-bd43-b48e7a88512f tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "DELETE /compute/v2.1/servers/268d786c-398a-4305-85ac-545fa3b4370b" status: 404 len: 111 microversion: 2.1 time: 0.067349 Aug 27 02:27:24.826227 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 475/970] 10.222.0.61 () {58 vars in 1239 bytes} [Sat Aug 27 02:27:24 2022] DELETE /compute/v2.1/servers/268d786c-398a-4305-85ac-545fa3b4370b => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:27:24.827430 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-523ed21b-c411-4dda-a896-8689500c1888 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:24.828041 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-523ed21b-c411-4dda-a896-8689500c1888 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] [instance: 268d786c-398a-4305-85ac-545fa3b4370b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:24.839256 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-523ed21b-c411-4dda-a896-8689500c1888 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:24.840111 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-523ed21b-c411-4dda-a896-8689500c1888 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:24.845242 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-523ed21b-c411-4dda-a896-8689500c1888 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:24.846728 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-523ed21b-c411-4dda-a896-8689500c1888 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:24.847408 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-523ed21b-c411-4dda-a896-8689500c1888 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:24.848035 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-523ed21b-c411-4dda-a896-8689500c1888 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:24.879089 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.wsgi [None req-523ed21b-c411-4dda-a896-8689500c1888 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] HTTP exception thrown: Instance 268d786c-398a-4305-85ac-545fa3b4370b could not be found. Aug 27 02:27:24.881088 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-523ed21b-c411-4dda-a896-8689500c1888 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Request method failure captured: Aug 27 02:27:24.881088 dv-cinder-846303-3-smb devstack@n-api.service[120782]: request: GET /compute/v2.1/servers/268d786c-398a-4305-85ac-545fa3b4370b HTTP/1.1 Aug 27 02:27:24.881088 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Accept: application/json Aug 27 02:27:24.881088 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Accept-Encoding: identity Aug 27 02:27:24.881088 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Connection: close Aug 27 02:27:24.881088 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Content-Length: 0 Aug 27 02:27:24.881088 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Content-Type: application/json Aug 27 02:27:24.881088 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Host: 10.222.0.61 Aug 27 02:27:24.881088 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Openstack-System-Scope: None Aug 27 02:27:24.881088 dv-cinder-846303-3-smb devstack@n-api.service[120782]: User-Agent: python-urllib3/1.26.11 Aug 27 02:27:24.881088 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Auth-Token: gAAAAABjCX-GZMxBoDm0UEKrtF9w1zn8zf5k_pRKs9w1w8QBRmamyePi9gdcvRwYzK044f89BKz1wZ6FALfNLv1C6uDnz_VZDZcPY_z2HcyDI5nmMGMvL5rG2v4zh3O1IrszVG_kNPPcMoviX7QaOQhXuRqD1X6DsEJwS6gyWrQ-SPSaYeWVQOw Aug 27 02:27:24.881088 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Domain-Id: None Aug 27 02:27:24.881088 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Domain-Name: None Aug 27 02:27:24.881088 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Identity-Status: Confirmed Aug 27 02:27:24.881088 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Is-Admin-Project: True Aug 27 02:27:24.881088 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Domain-Id: default Aug 27 02:27:24.881088 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Domain-Name: Default Aug 27 02:27:24.881088 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Id: 8aa1c411b57d4e72885dac2b4f4dfe7a Aug 27 02:27:24.881088 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Name: tempest-AttachVolumeNegativeTest-799378516 Aug 27 02:27:24.881088 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Role: member,reader Aug 27 02:27:24.881088 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Roles: member,reader Aug 27 02:27:24.882556 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/8aa1c411b57d4e72885dac2b4f4dfe7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_8aa1c411b57d4e72885dac2b4f4dfe7a", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8aa1c411b57d4e72885dac2b4f4dfe7a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8aa1c411b57d4e72885dac2b4f4dfe7a"}]}] Aug 27 02:27:24.882556 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Tenant: tempest-AttachVolumeNegativeTest-799378516 Aug 27 02:27:24.882556 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Tenant-Id: 8aa1c411b57d4e72885dac2b4f4dfe7a Aug 27 02:27:24.882556 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-799378516 Aug 27 02:27:24.882556 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User: tempest-AttachVolumeNegativeTest-799378516-project Aug 27 02:27:24.882556 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Domain-Id: default Aug 27 02:27:24.882556 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Domain-Name: Default Aug 27 02:27:24.882556 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Id: 4a6f819365574091ae344f14e47f487f Aug 27 02:27:24.882556 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Name: tempest-AttachVolumeNegativeTest-799378516-project Aug 27 02:27:24.882556 dv-cinder-846303-3-smb devstack@n-api.service[120782]: method: > Aug 27 02:27:24.882556 dv-cinder-846303-3-smb devstack@n-api.service[120782]: exception: Instance 268d786c-398a-4305-85ac-545fa3b4370b could not be found. Aug 27 02:27:24.882556 dv-cinder-846303-3-smb devstack@n-api.service[120782]: action_args: {'id': '268d786c-398a-4305-85ac-545fa3b4370b'} Aug 27 02:27:24.883326 dv-cinder-846303-3-smb devstack@n-api.service[120782]: {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:27:24.883326 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:24.883326 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:27:24.883326 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:27:24.883326 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:27:24.883326 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:27:24.883326 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:27:24.883326 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:27:24.883326 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:27:24.883326 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:27:24.883326 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 268d786c-398a-4305-85ac-545fa3b4370b could not be found. Aug 27 02:27:24.883326 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:27:24.883326 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:27:24.883326 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:27:24.883326 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:24.883326 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:27:24.883326 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:27:24.883326 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:27:24.883326 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:27:24.883326 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:27:24.884676 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:27:24.884676 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:27:24.884676 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:27:24.884676 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:27:24.884676 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:27:24.884676 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:27:24.884676 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:27:24.884676 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 268d786c-398a-4305-85ac-545fa3b4370b could not be found. Aug 27 02:27:24.884676 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:27:24.884676 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:27:24.884676 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:27:24.884676 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:24.884676 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:27:24.884676 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:27:24.884676 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:27:24.884676 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:27:24.884676 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 268d786c-398a-4305-85ac-545fa3b4370b could not be found. Aug 27 02:27:24.884676 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:27:24.888076 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-523ed21b-c411-4dda-a896-8689500c1888 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] Returning 404 to user: Instance 268d786c-398a-4305-85ac-545fa3b4370b could not be found. {{(pid=120782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:27:24.888076 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-523ed21b-c411-4dda-a896-8689500c1888 tempest-AttachVolumeNegativeTest-799378516 tempest-AttachVolumeNegativeTest-799378516-project] 10.222.0.61 "GET /compute/v2.1/servers/268d786c-398a-4305-85ac-545fa3b4370b" status: 404 len: 111 microversion: 2.1 time: 0.059151 Aug 27 02:27:24.890250 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 496/971] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:24 2022] GET /compute/v2.1/servers/268d786c-398a-4305-85ac-545fa3b4370b => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:27:25.123485 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-a66fcd08-bc23-4a67-bf34-8c8b944ec638 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:25.124521 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-a66fcd08-bc23-4a67-bf34-8c8b944ec638 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 99f2f366-4776-427e-99cf-79399835f2c8] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:25.131952 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a66fcd08-bc23-4a67-bf34-8c8b944ec638 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:25.132813 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a66fcd08-bc23-4a67-bf34-8c8b944ec638 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:25.133558 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a66fcd08-bc23-4a67-bf34-8c8b944ec638 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:25.134571 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a66fcd08-bc23-4a67-bf34-8c8b944ec638 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:25.135242 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a66fcd08-bc23-4a67-bf34-8c8b944ec638 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:25.135877 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a66fcd08-bc23-4a67-bf34-8c8b944ec638 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:25.258467 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-439a439d-daed-48a1-a715-beacd89577be tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:25.259513 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-439a439d-daed-48a1-a715-beacd89577be tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] [instance: 9fb59350-4f09-4e20-bddb-ffc9a65897b3] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:25.267702 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-439a439d-daed-48a1-a715-beacd89577be tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:25.268676 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-439a439d-daed-48a1-a715-beacd89577be tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:25.269543 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-439a439d-daed-48a1-a715-beacd89577be tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:25.273744 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-439a439d-daed-48a1-a715-beacd89577be tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:25.274633 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-439a439d-daed-48a1-a715-beacd89577be tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:25.275147 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-439a439d-daed-48a1-a715-beacd89577be tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:25.475407 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-439a439d-daed-48a1-a715-beacd89577be tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f53d57f3544e5a25e1beeddab9af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2d4ae1c228446eb5bfc64d44348fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:25.487044 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-439a439d-daed-48a1-a715-beacd89577be tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] 10.222.0.61 "GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3" status: 200 len: 1577 microversion: 2.1 time: 0.243142 Aug 27 02:27:25.488475 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 497/972] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:25 2022] GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3 => generated 1577 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:25.615968 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-a66fcd08-bc23-4a67-bf34-8c8b944ec638 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:25.634479 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-a66fcd08-bc23-4a67-bf34-8c8b944ec638 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:25.635917 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-a66fcd08-bc23-4a67-bf34-8c8b944ec638 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:25.642485 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-a66fcd08-bc23-4a67-bf34-8c8b944ec638 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8" status: 200 len: 1729 microversion: 2.20 time: 0.519773 Aug 27 02:27:25.654289 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 476/973] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:27:25 2022] GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8 => generated 1729 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:27:26.518652 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-61d3b80b-e0a0-4dec-a86d-c497765fef5a tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:26.520249 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-61d3b80b-e0a0-4dec-a86d-c497765fef5a tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] [instance: 9fb59350-4f09-4e20-bddb-ffc9a65897b3] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:26.560277 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-61d3b80b-e0a0-4dec-a86d-c497765fef5a tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:26.560830 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-61d3b80b-e0a0-4dec-a86d-c497765fef5a tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:26.561280 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-61d3b80b-e0a0-4dec-a86d-c497765fef5a tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:26.562065 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-61d3b80b-e0a0-4dec-a86d-c497765fef5a tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:26.565824 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-61d3b80b-e0a0-4dec-a86d-c497765fef5a tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:26.566554 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-61d3b80b-e0a0-4dec-a86d-c497765fef5a tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:26.675651 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-182ab017-dd49-4dcd-abf5-066366118f75 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:26.677144 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-182ab017-dd49-4dcd-abf5-066366118f75 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 99f2f366-4776-427e-99cf-79399835f2c8] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:26.693981 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-182ab017-dd49-4dcd-abf5-066366118f75 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:26.694778 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-182ab017-dd49-4dcd-abf5-066366118f75 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:26.695484 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-182ab017-dd49-4dcd-abf5-066366118f75 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:26.699009 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-182ab017-dd49-4dcd-abf5-066366118f75 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:26.700138 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-182ab017-dd49-4dcd-abf5-066366118f75 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:26.701178 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-182ab017-dd49-4dcd-abf5-066366118f75 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:26.706966 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell1:SELECT=100 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:27:26.905909 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-61d3b80b-e0a0-4dec-a86d-c497765fef5a tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f53d57f3544e5a25e1beeddab9af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2d4ae1c228446eb5bfc64d44348fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:26.916595 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-182ab017-dd49-4dcd-abf5-066366118f75 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:26.921047 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-61d3b80b-e0a0-4dec-a86d-c497765fef5a tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] 10.222.0.61 "GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3" status: 200 len: 1577 microversion: 2.1 time: 0.416061 Aug 27 02:27:26.921961 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 498/974] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:26 2022] GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3 => generated 1577 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:26.932029 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-182ab017-dd49-4dcd-abf5-066366118f75 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:26.936066 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-182ab017-dd49-4dcd-abf5-066366118f75 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:26.937385 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-182ab017-dd49-4dcd-abf5-066366118f75 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8" status: 200 len: 1729 microversion: 2.20 time: 0.266402 Aug 27 02:27:26.938016 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 477/975] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:27:26 2022] GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8 => generated 1729 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:27:27.949348 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-22b1f95c-d62c-4628-ab5d-c8c989d22b57 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:27.950582 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-22b1f95c-d62c-4628-ab5d-c8c989d22b57 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] [instance: 9fb59350-4f09-4e20-bddb-ffc9a65897b3] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:27.962524 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-22b1f95c-d62c-4628-ab5d-c8c989d22b57 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:27.965116 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-22b1f95c-d62c-4628-ab5d-c8c989d22b57 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:27.965778 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-22b1f95c-d62c-4628-ab5d-c8c989d22b57 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:27.968119 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-22b1f95c-d62c-4628-ab5d-c8c989d22b57 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:27.969079 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-61d72f43-d1b2-43f2-8ee0-025b72a08439 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:27.969930 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-61d72f43-d1b2-43f2-8ee0-025b72a08439 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 99f2f366-4776-427e-99cf-79399835f2c8] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:27.970483 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-22b1f95c-d62c-4628-ab5d-c8c989d22b57 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:27.973270 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-22b1f95c-d62c-4628-ab5d-c8c989d22b57 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:27.989839 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-61d72f43-d1b2-43f2-8ee0-025b72a08439 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:27.992485 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-61d72f43-d1b2-43f2-8ee0-025b72a08439 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:27.995038 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-61d72f43-d1b2-43f2-8ee0-025b72a08439 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:27.998956 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-61d72f43-d1b2-43f2-8ee0-025b72a08439 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:28.001786 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-61d72f43-d1b2-43f2-8ee0-025b72a08439 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:28.006138 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-61d72f43-d1b2-43f2-8ee0-025b72a08439 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:28.241678 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-22b1f95c-d62c-4628-ab5d-c8c989d22b57 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f53d57f3544e5a25e1beeddab9af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2d4ae1c228446eb5bfc64d44348fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:28.250126 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-22b1f95c-d62c-4628-ab5d-c8c989d22b57 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] 10.222.0.61 "GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3" status: 200 len: 1577 microversion: 2.1 time: 0.305921 Aug 27 02:27:28.250687 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 499/976] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:27 2022] GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3 => generated 1577 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:28.605312 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-61d72f43-d1b2-43f2-8ee0-025b72a08439 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:28.615959 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-61d72f43-d1b2-43f2-8ee0-025b72a08439 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:28.617586 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-61d72f43-d1b2-43f2-8ee0-025b72a08439 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:28.618875 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-61d72f43-d1b2-43f2-8ee0-025b72a08439 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8" status: 200 len: 1729 microversion: 2.20 time: 0.655483 Aug 27 02:27:28.619497 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 478/977] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:27:27 2022] GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8 => generated 1729 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:27:29.274548 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-c8fbdb47-386d-49d4-9845-11e67d4a90f2 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:29.276515 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-c8fbdb47-386d-49d4-9845-11e67d4a90f2 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] [instance: 9fb59350-4f09-4e20-bddb-ffc9a65897b3] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:29.284454 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c8fbdb47-386d-49d4-9845-11e67d4a90f2 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:29.285336 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c8fbdb47-386d-49d4-9845-11e67d4a90f2 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:29.285938 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c8fbdb47-386d-49d4-9845-11e67d4a90f2 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:29.286816 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c8fbdb47-386d-49d4-9845-11e67d4a90f2 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:29.287592 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c8fbdb47-386d-49d4-9845-11e67d4a90f2 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:29.288165 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c8fbdb47-386d-49d4-9845-11e67d4a90f2 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:29.600284 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-c8fbdb47-386d-49d4-9845-11e67d4a90f2 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f53d57f3544e5a25e1beeddab9af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2d4ae1c228446eb5bfc64d44348fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:29.615558 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-c8fbdb47-386d-49d4-9845-11e67d4a90f2 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] 10.222.0.61 "GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3" status: 200 len: 1577 microversion: 2.1 time: 0.346341 Aug 27 02:27:29.617667 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 500/978] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:29 2022] GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3 => generated 1577 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:29.643272 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-5f1ca471-9f1a-4f1f-8381-051529df1cba tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:29.644838 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-5f1ca471-9f1a-4f1f-8381-051529df1cba tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 99f2f366-4776-427e-99cf-79399835f2c8] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:29.655684 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5f1ca471-9f1a-4f1f-8381-051529df1cba tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:29.660868 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5f1ca471-9f1a-4f1f-8381-051529df1cba tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:29.661924 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5f1ca471-9f1a-4f1f-8381-051529df1cba tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:29.664624 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5f1ca471-9f1a-4f1f-8381-051529df1cba tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:29.665299 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5f1ca471-9f1a-4f1f-8381-051529df1cba tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:29.667017 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5f1ca471-9f1a-4f1f-8381-051529df1cba tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:29.875759 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-ff22db94-52c2-4ce7-bb68-798da4ee552c tempest-VolumesNegativeTest-677531971 tempest-VolumesNegativeTest-677531971-project] Action: 'create', calling method: .version_select at 0x7fd808499c10>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-396397522", "metadata": {"Type": "work"}}} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:27:29.898104 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-ff22db94-52c2-4ce7-bb68-798da4ee552c tempest-VolumesNegativeTest-677531971 tempest-VolumesNegativeTest-677531971-project] Request method failure captured: Aug 27 02:27:29.898104 dv-cinder-846303-3-smb devstack@n-api.service[120782]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 27 02:27:29.898104 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Accept: application/json Aug 27 02:27:29.898104 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Accept-Encoding: identity Aug 27 02:27:29.898104 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Connection: close Aug 27 02:27:29.898104 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Content-Length: 121 Aug 27 02:27:29.898104 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Content-Type: application/json Aug 27 02:27:29.898104 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Host: 10.222.0.61 Aug 27 02:27:29.898104 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Openstack-System-Scope: None Aug 27 02:27:29.898104 dv-cinder-846303-3-smb devstack@n-api.service[120782]: User-Agent: python-urllib3/1.26.11 Aug 27 02:27:29.898104 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Auth-Token: gAAAAABjCYERdVlydHI2nKDMXuHHbVsXRa3VOwX0BLeTN4KJuU6zmzeI1vxR6kV6GazZz13accilbQtATnDNKH1Dd48IhakUJzYlJnCRyI2aPV5xtdcXD9XGuYAnWqODkqh0CT6qdXQzOnytgsvTE8rh5AkQDmwcb3tCb-LsntAlYVGowr8JGdU Aug 27 02:27:29.898104 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Domain-Id: None Aug 27 02:27:29.898104 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Domain-Name: None Aug 27 02:27:29.898104 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Identity-Status: Confirmed Aug 27 02:27:29.898104 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Is-Admin-Project: True Aug 27 02:27:29.898104 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Domain-Id: default Aug 27 02:27:29.898104 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Domain-Name: Default Aug 27 02:27:29.898104 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Id: 45415e2ac2d34e269d466de054b7597e Aug 27 02:27:29.898104 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Name: tempest-VolumesNegativeTest-677531971 Aug 27 02:27:29.898104 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Role: member,reader Aug 27 02:27:29.898104 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Roles: member,reader Aug 27 02:27:29.899910 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/45415e2ac2d34e269d466de054b7597e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_45415e2ac2d34e269d466de054b7597e", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/45415e2ac2d34e269d466de054b7597e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/45415e2ac2d34e269d466de054b7597e"}]}] Aug 27 02:27:29.899910 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Tenant: tempest-VolumesNegativeTest-677531971 Aug 27 02:27:29.899910 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Tenant-Id: 45415e2ac2d34e269d466de054b7597e Aug 27 02:27:29.899910 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Tenant-Name: tempest-VolumesNegativeTest-677531971 Aug 27 02:27:29.899910 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User: tempest-VolumesNegativeTest-677531971-project Aug 27 02:27:29.899910 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Domain-Id: default Aug 27 02:27:29.899910 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Domain-Name: Default Aug 27 02:27:29.899910 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Id: 3cda8d65fcf344139bd3b6dd0df039a9 Aug 27 02:27:29.899910 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Name: tempest-VolumesNegativeTest-677531971-project Aug 27 02:27:29.899910 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Aug 27 02:27:29.899910 dv-cinder-846303-3-smb devstack@n-api.service[120782]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-396397522", "metadata": {"Type": "work"}}} Aug 27 02:27:29.899910 dv-cinder-846303-3-smb devstack@n-api.service[120782]: method: Aug 27 02:27:29.899910 dv-cinder-846303-3-smb devstack@n-api.service[120782]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 27 02:27:29.900954 dv-cinder-846303-3-smb devstack@n-api.service[120782]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-396397522', 'metadata': {'Type': 'work'}}}} Aug 27 02:27:29.900954 dv-cinder-846303-3-smb devstack@n-api.service[120782]: {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:27:29.900954 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:29.900954 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 02:27:29.900954 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 02:27:29.900954 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 02:27:29.900954 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise error Aug 27 02:27:29.900954 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 27 02:27:29.900954 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:27:29.900954 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 27 02:27:29.900954 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 27 02:27:29.900954 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:27:29.900954 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 27 02:27:29.900954 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi '#$%' Aug 27 02:27:29.900954 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:27:29.900954 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:27:29.900954 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:27:29.900954 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:29.900954 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:27:29.900954 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:27:29.900954 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:27:29.900954 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:27:29.902823 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:27:29.902823 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:27:29.902823 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:27:29.902823 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:27:29.902823 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 02:27:29.902823 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 02:27:29.902823 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 02:27:29.902823 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 02:27:29.902823 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 02:27:29.902823 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 02:27:29.902823 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 27 02:27:29.902823 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:27:29.902823 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:27:29.902823 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:27:29.902823 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:29.902823 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:27:29.902823 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:27:29.902823 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 02:27:29.902823 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 02:27:29.904082 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 27 02:27:29.904082 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:27:29.904082 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-ff22db94-52c2-4ce7-bb68-798da4ee552c tempest-VolumesNegativeTest-677531971 tempest-VolumesNegativeTest-677531971-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:27:29.904082 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-ff22db94-52c2-4ce7-bb68-798da4ee552c tempest-VolumesNegativeTest-677531971 tempest-VolumesNegativeTest-677531971-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.209934 Aug 27 02:27:29.904082 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 501/979] 10.222.0.61 () {60 vars in 1156 bytes} [Sat Aug 27 02:27:29 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 212 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:27:29.916728 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-c68bcbec-6c95-4809-9972-830daacfc865 tempest-VolumesNegativeTest-677531971 tempest-VolumesNegativeTest-677531971-project] Action: 'create', calling method: .version_select at 0x7fd808573310>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-625199943", "metadata": {"Type": "work"}}} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:27:29.922179 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-c68bcbec-6c95-4809-9972-830daacfc865 tempest-VolumesNegativeTest-677531971 tempest-VolumesNegativeTest-677531971-project] Request method failure captured: Aug 27 02:27:29.922179 dv-cinder-846303-3-smb devstack@n-api.service[120782]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 27 02:27:29.922179 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Accept: application/json Aug 27 02:27:29.922179 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Accept-Encoding: identity Aug 27 02:27:29.922179 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Connection: close Aug 27 02:27:29.922179 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Content-Length: 119 Aug 27 02:27:29.922179 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Content-Type: application/json Aug 27 02:27:29.922179 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Host: 10.222.0.61 Aug 27 02:27:29.922179 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Openstack-System-Scope: None Aug 27 02:27:29.922179 dv-cinder-846303-3-smb devstack@n-api.service[120782]: User-Agent: python-urllib3/1.26.11 Aug 27 02:27:29.922179 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Auth-Token: gAAAAABjCYERdVlydHI2nKDMXuHHbVsXRa3VOwX0BLeTN4KJuU6zmzeI1vxR6kV6GazZz13accilbQtATnDNKH1Dd48IhakUJzYlJnCRyI2aPV5xtdcXD9XGuYAnWqODkqh0CT6qdXQzOnytgsvTE8rh5AkQDmwcb3tCb-LsntAlYVGowr8JGdU Aug 27 02:27:29.922179 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Domain-Id: None Aug 27 02:27:29.922179 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Domain-Name: None Aug 27 02:27:29.922179 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Identity-Status: Confirmed Aug 27 02:27:29.922179 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Is-Admin-Project: True Aug 27 02:27:29.922179 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Domain-Id: default Aug 27 02:27:29.922179 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Domain-Name: Default Aug 27 02:27:29.922179 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Id: 45415e2ac2d34e269d466de054b7597e Aug 27 02:27:29.922179 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Name: tempest-VolumesNegativeTest-677531971 Aug 27 02:27:29.922179 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Role: member,reader Aug 27 02:27:29.922179 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Roles: member,reader Aug 27 02:27:29.923846 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/45415e2ac2d34e269d466de054b7597e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_45415e2ac2d34e269d466de054b7597e", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/45415e2ac2d34e269d466de054b7597e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/45415e2ac2d34e269d466de054b7597e"}]}] Aug 27 02:27:29.923846 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Tenant: tempest-VolumesNegativeTest-677531971 Aug 27 02:27:29.923846 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Tenant-Id: 45415e2ac2d34e269d466de054b7597e Aug 27 02:27:29.923846 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Tenant-Name: tempest-VolumesNegativeTest-677531971 Aug 27 02:27:29.923846 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User: tempest-VolumesNegativeTest-677531971-project Aug 27 02:27:29.923846 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Domain-Id: default Aug 27 02:27:29.923846 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Domain-Name: Default Aug 27 02:27:29.923846 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Id: 3cda8d65fcf344139bd3b6dd0df039a9 Aug 27 02:27:29.923846 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Name: tempest-VolumesNegativeTest-677531971-project Aug 27 02:27:29.923846 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Aug 27 02:27:29.923846 dv-cinder-846303-3-smb devstack@n-api.service[120782]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-625199943", "metadata": {"Type": "work"}}} Aug 27 02:27:29.923846 dv-cinder-846303-3-smb devstack@n-api.service[120782]: method: Aug 27 02:27:29.923846 dv-cinder-846303-3-smb devstack@n-api.service[120782]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 27 02:27:29.924849 dv-cinder-846303-3-smb devstack@n-api.service[120782]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-625199943', 'metadata': {'Type': 'work'}}}} Aug 27 02:27:29.924849 dv-cinder-846303-3-smb devstack@n-api.service[120782]: {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:27:29.924849 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:29.924849 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 02:27:29.924849 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 02:27:29.924849 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 02:27:29.924849 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise error Aug 27 02:27:29.924849 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 27 02:27:29.924849 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:27:29.924849 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 27 02:27:29.924849 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 27 02:27:29.924849 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:27:29.924849 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 27 02:27:29.924849 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi '0' Aug 27 02:27:29.924849 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:27:29.924849 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:27:29.924849 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:27:29.924849 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:29.924849 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:27:29.924849 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:27:29.924849 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:27:29.924849 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:27:29.926592 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:27:29.926592 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:27:29.926592 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:27:29.926592 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:27:29.926592 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 02:27:29.926592 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 02:27:29.926592 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 02:27:29.926592 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 02:27:29.926592 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 02:27:29.926592 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 02:27:29.926592 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 27 02:27:29.926592 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:27:29.926592 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:27:29.926592 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:27:29.926592 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:29.926592 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:27:29.926592 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:27:29.926592 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 02:27:29.926592 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 02:27:29.927947 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 27 02:27:29.927947 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:27:29.927947 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-c68bcbec-6c95-4809-9972-830daacfc865 tempest-VolumesNegativeTest-677531971 tempest-VolumesNegativeTest-677531971-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:27:29.928851 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-c68bcbec-6c95-4809-9972-830daacfc865 tempest-VolumesNegativeTest-677531971 tempest-VolumesNegativeTest-677531971-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.016807 Aug 27 02:27:29.933587 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 502/980] 10.222.0.61 () {60 vars in 1156 bytes} [Sat Aug 27 02:27:29 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 27 02:27:29.940544 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-92ddb770-7062-43a9-a144-e2646b6b89a3 tempest-VolumesNegativeTest-677531971 tempest-VolumesNegativeTest-677531971-project] Action: 'create', calling method: .version_select at 0x7fd808946dc0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1613677866", "metadata": {"Type": "work"}}} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:27:29.945337 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-92ddb770-7062-43a9-a144-e2646b6b89a3 tempest-VolumesNegativeTest-677531971 tempest-VolumesNegativeTest-677531971-project] Request method failure captured: Aug 27 02:27:29.945337 dv-cinder-846303-3-smb devstack@n-api.service[120782]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 27 02:27:29.945337 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Accept: application/json Aug 27 02:27:29.945337 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Accept-Encoding: identity Aug 27 02:27:29.945337 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Connection: close Aug 27 02:27:29.945337 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Content-Length: 119 Aug 27 02:27:29.945337 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Content-Type: application/json Aug 27 02:27:29.945337 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Host: 10.222.0.61 Aug 27 02:27:29.945337 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Openstack-System-Scope: None Aug 27 02:27:29.945337 dv-cinder-846303-3-smb devstack@n-api.service[120782]: User-Agent: python-urllib3/1.26.11 Aug 27 02:27:29.945337 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Auth-Token: gAAAAABjCYERdVlydHI2nKDMXuHHbVsXRa3VOwX0BLeTN4KJuU6zmzeI1vxR6kV6GazZz13accilbQtATnDNKH1Dd48IhakUJzYlJnCRyI2aPV5xtdcXD9XGuYAnWqODkqh0CT6qdXQzOnytgsvTE8rh5AkQDmwcb3tCb-LsntAlYVGowr8JGdU Aug 27 02:27:29.945337 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Domain-Id: None Aug 27 02:27:29.945337 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Domain-Name: None Aug 27 02:27:29.945337 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Identity-Status: Confirmed Aug 27 02:27:29.945337 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Is-Admin-Project: True Aug 27 02:27:29.945337 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Domain-Id: default Aug 27 02:27:29.945337 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Domain-Name: Default Aug 27 02:27:29.945337 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Id: 45415e2ac2d34e269d466de054b7597e Aug 27 02:27:29.945337 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Name: tempest-VolumesNegativeTest-677531971 Aug 27 02:27:29.945337 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Role: member,reader Aug 27 02:27:29.945337 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Roles: member,reader Aug 27 02:27:29.947015 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/45415e2ac2d34e269d466de054b7597e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_45415e2ac2d34e269d466de054b7597e", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/45415e2ac2d34e269d466de054b7597e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/45415e2ac2d34e269d466de054b7597e"}]}] Aug 27 02:27:29.947015 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Tenant: tempest-VolumesNegativeTest-677531971 Aug 27 02:27:29.947015 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Tenant-Id: 45415e2ac2d34e269d466de054b7597e Aug 27 02:27:29.947015 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Tenant-Name: tempest-VolumesNegativeTest-677531971 Aug 27 02:27:29.947015 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User: tempest-VolumesNegativeTest-677531971-project Aug 27 02:27:29.947015 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Domain-Id: default Aug 27 02:27:29.947015 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Domain-Name: Default Aug 27 02:27:29.947015 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Id: 3cda8d65fcf344139bd3b6dd0df039a9 Aug 27 02:27:29.947015 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Name: tempest-VolumesNegativeTest-677531971-project Aug 27 02:27:29.947015 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Aug 27 02:27:29.947015 dv-cinder-846303-3-smb devstack@n-api.service[120782]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1613677866", "metadata": {"Type": "work"}}} Aug 27 02:27:29.947015 dv-cinder-846303-3-smb devstack@n-api.service[120782]: method: Aug 27 02:27:29.947015 dv-cinder-846303-3-smb devstack@n-api.service[120782]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 27 02:27:29.948051 dv-cinder-846303-3-smb devstack@n-api.service[120782]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1613677866', 'metadata': {'Type': 'work'}}}} Aug 27 02:27:29.948051 dv-cinder-846303-3-smb devstack@n-api.service[120782]: {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:27:29.948051 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:29.948051 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 02:27:29.948051 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 02:27:29.948051 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 02:27:29.948051 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise error Aug 27 02:27:29.948051 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 27 02:27:29.948051 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:27:29.948051 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 27 02:27:29.948051 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 27 02:27:29.948051 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:27:29.948051 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 27 02:27:29.948051 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi '' Aug 27 02:27:29.948051 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:27:29.948051 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:27:29.948051 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:27:29.948051 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:29.948051 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:27:29.948051 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:27:29.948051 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:27:29.948051 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:27:29.949766 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:27:29.949766 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:27:29.949766 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:27:29.949766 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:27:29.949766 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 02:27:29.949766 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 02:27:29.949766 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 02:27:29.949766 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 02:27:29.949766 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 02:27:29.949766 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 02:27:29.949766 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 27 02:27:29.949766 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:27:29.949766 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:27:29.949766 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:27:29.949766 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:29.949766 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:27:29.949766 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:27:29.949766 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 02:27:29.949766 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 02:27:29.951683 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 27 02:27:29.951683 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:27:29.954568 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-92ddb770-7062-43a9-a144-e2646b6b89a3 tempest-VolumesNegativeTest-677531971 tempest-VolumesNegativeTest-677531971-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:27:29.960972 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-5f1ca471-9f1a-4f1f-8381-051529df1cba tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:29.962317 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-92ddb770-7062-43a9-a144-e2646b6b89a3 tempest-VolumesNegativeTest-677531971 tempest-VolumesNegativeTest-677531971-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.026141 Aug 27 02:27:29.962919 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 503/981] 10.222.0.61 () {60 vars in 1156 bytes} [Sat Aug 27 02:27:29 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:27:29.972426 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-1160bfd9-3226-4ff2-9543-48a944296d82 tempest-VolumesNegativeTest-677531971 tempest-VolumesNegativeTest-677531971-project] Calling method '.version_select at 0x7fd8083d6040>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:29.976430 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-5f1ca471-9f1a-4f1f-8381-051529df1cba tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:29.977897 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-5f1ca471-9f1a-4f1f-8381-051529df1cba tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:29.979298 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-5f1ca471-9f1a-4f1f-8381-051529df1cba tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8" status: 200 len: 1729 microversion: 2.20 time: 0.340679 Aug 27 02:27:29.980054 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 479/982] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:27:29 2022] GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8 => generated 1729 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:27:30.002012 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.wsgi [None req-1160bfd9-3226-4ff2-9543-48a944296d82 tempest-VolumesNegativeTest-677531971 tempest-VolumesNegativeTest-677531971-project] HTTP exception thrown: Volume tempest-invalid-2132325663 could not be found. Aug 27 02:27:30.005231 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-1160bfd9-3226-4ff2-9543-48a944296d82 tempest-VolumesNegativeTest-677531971 tempest-VolumesNegativeTest-677531971-project] Request method failure captured: Aug 27 02:27:30.005231 dv-cinder-846303-3-smb devstack@n-api.service[120782]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-2132325663 HTTP/1.1 Aug 27 02:27:30.005231 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Accept: application/json Aug 27 02:27:30.005231 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Accept-Encoding: identity Aug 27 02:27:30.005231 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Connection: close Aug 27 02:27:30.005231 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Content-Length: 0 Aug 27 02:27:30.005231 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Content-Type: application/json Aug 27 02:27:30.005231 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Host: 10.222.0.61 Aug 27 02:27:30.005231 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Openstack-System-Scope: None Aug 27 02:27:30.005231 dv-cinder-846303-3-smb devstack@n-api.service[120782]: User-Agent: python-urllib3/1.26.11 Aug 27 02:27:30.005231 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Auth-Token: gAAAAABjCYERdVlydHI2nKDMXuHHbVsXRa3VOwX0BLeTN4KJuU6zmzeI1vxR6kV6GazZz13accilbQtATnDNKH1Dd48IhakUJzYlJnCRyI2aPV5xtdcXD9XGuYAnWqODkqh0CT6qdXQzOnytgsvTE8rh5AkQDmwcb3tCb-LsntAlYVGowr8JGdU Aug 27 02:27:30.005231 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Domain-Id: None Aug 27 02:27:30.005231 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Domain-Name: None Aug 27 02:27:30.005231 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Identity-Status: Confirmed Aug 27 02:27:30.005231 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Is-Admin-Project: True Aug 27 02:27:30.005231 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Domain-Id: default Aug 27 02:27:30.005231 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Domain-Name: Default Aug 27 02:27:30.005231 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Id: 45415e2ac2d34e269d466de054b7597e Aug 27 02:27:30.005231 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Name: tempest-VolumesNegativeTest-677531971 Aug 27 02:27:30.005231 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Role: member,reader Aug 27 02:27:30.005231 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Roles: member,reader Aug 27 02:27:30.006878 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/45415e2ac2d34e269d466de054b7597e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_45415e2ac2d34e269d466de054b7597e", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/45415e2ac2d34e269d466de054b7597e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/45415e2ac2d34e269d466de054b7597e"}]}] Aug 27 02:27:30.006878 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Tenant: tempest-VolumesNegativeTest-677531971 Aug 27 02:27:30.006878 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Tenant-Id: 45415e2ac2d34e269d466de054b7597e Aug 27 02:27:30.006878 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Tenant-Name: tempest-VolumesNegativeTest-677531971 Aug 27 02:27:30.006878 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User: tempest-VolumesNegativeTest-677531971-project Aug 27 02:27:30.006878 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Domain-Id: default Aug 27 02:27:30.006878 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Domain-Name: Default Aug 27 02:27:30.006878 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Id: 3cda8d65fcf344139bd3b6dd0df039a9 Aug 27 02:27:30.006878 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Name: tempest-VolumesNegativeTest-677531971-project Aug 27 02:27:30.006878 dv-cinder-846303-3-smb devstack@n-api.service[120782]: method: Aug 27 02:27:30.006878 dv-cinder-846303-3-smb devstack@n-api.service[120782]: exception: Volume tempest-invalid-2132325663 could not be found. Aug 27 02:27:30.006878 dv-cinder-846303-3-smb devstack@n-api.service[120782]: action_args: {'id': 'tempest-invalid-2132325663'} Aug 27 02:27:30.006878 dv-cinder-846303-3-smb devstack@n-api.service[120782]: {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:27:30.007801 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:30.007801 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 02:27:30.007801 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 02:27:30.007801 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 27 02:27:30.007801 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 27 02:27:30.007801 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 27 02:27:30.007801 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 27 02:27:30.007801 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 27 02:27:30.007801 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 27 02:27:30.007801 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 27 02:27:30.007801 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 27 02:27:30.007801 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 02:27:30.007801 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 02:27:30.007801 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 02:27:30.007801 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 02:27:30.007801 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-2132325663 could not be found. (HTTP 404) (Request-ID: req-339c084a-b002-44cb-ba05-c62ab7b5268d) Aug 27 02:27:30.007801 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:27:30.007801 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:27:30.007801 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:27:30.009209 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:30.009209 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 27 02:27:30.009209 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 27 02:27:30.009209 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 27 02:27:30.009209 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 27 02:27:30.009209 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 27 02:27:30.009209 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 27 02:27:30.009209 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 27 02:27:30.009209 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 27 02:27:30.009209 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 02:27:30.009209 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 02:27:30.009209 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 27 02:27:30.009209 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 27 02:27:30.009209 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 27 02:27:30.009209 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 27 02:27:30.009209 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 27 02:27:30.009209 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 27 02:27:30.009209 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 27 02:27:30.009209 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 27 02:27:30.010596 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 02:27:30.010596 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 02:27:30.010596 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 02:27:30.010596 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 02:27:30.010596 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-2132325663 could not be found. Aug 27 02:27:30.010596 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:27:30.010596 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:27:30.010596 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:27:30.010596 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:30.010596 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:27:30.010596 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:27:30.010596 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:27:30.010596 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:27:30.010596 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:27:30.010596 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:27:30.010596 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:27:30.010596 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:27:30.010596 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 27 02:27:30.010596 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:27:30.010596 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-2132325663 could not be found. Aug 27 02:27:30.012097 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:27:30.012097 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:27:30.012097 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:27:30.012097 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:30.012097 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:27:30.012097 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:27:30.012097 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:27:30.012097 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:27:30.012097 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-2132325663 could not be found. Aug 27 02:27:30.012097 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:27:30.012097 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-1160bfd9-3226-4ff2-9543-48a944296d82 tempest-VolumesNegativeTest-677531971 tempest-VolumesNegativeTest-677531971-project] Returning 404 to user: Volume tempest-invalid-2132325663 could not be found. {{(pid=120782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:27:30.012097 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-1160bfd9-3226-4ff2-9543-48a944296d82 tempest-VolumesNegativeTest-677531971 tempest-VolumesNegativeTest-677531971-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/tempest-invalid-2132325663" status: 404 len: 99 microversion: 2.1 time: 0.038558 Aug 27 02:27:30.012097 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 504/983] 10.222.0.61 () {58 vars in 1218 bytes} [Sat Aug 27 02:27:29 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-2132325663 => generated 99 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 27 02:27:30.019976 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-f7807621-2644-4339-a62b-5d71f4e1b8c3 tempest-VolumesNegativeTest-677531971 tempest-VolumesNegativeTest-677531971-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005363 Aug 27 02:27:30.021443 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 480/984] 10.222.0.61 () {58 vars in 1140 bytes} [Sat Aug 27 02:27:30 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 27 02:27:30.031802 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-64502ff7-8682-4872-97ff-0d6bb2e31b0b tempest-VolumesNegativeTest-677531971 tempest-VolumesNegativeTest-677531971-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005357 Aug 27 02:27:30.032788 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 505/985] 10.222.0.61 () {58 vars in 1137 bytes} [Sat Aug 27 02:27:30 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Aug 27 02:27:30.043142 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-e7555bf4-ab6a-4bef-8ade-7b2929ce3fa3 tempest-VolumesNegativeTest-677531971 tempest-VolumesNegativeTest-677531971-project] Calling method '.version_select at 0x7fd8083fcdc0>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:30.076159 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.wsgi [None req-e7555bf4-ab6a-4bef-8ade-7b2929ce3fa3 tempest-VolumesNegativeTest-677531971 tempest-VolumesNegativeTest-677531971-project] HTTP exception thrown: Volume 324b1753-7041-4704-b8b7-643ecdc20d61 could not be found. Aug 27 02:27:30.079157 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-e7555bf4-ab6a-4bef-8ade-7b2929ce3fa3 tempest-VolumesNegativeTest-677531971 tempest-VolumesNegativeTest-677531971-project] Request method failure captured: Aug 27 02:27:30.079157 dv-cinder-846303-3-smb devstack@n-api.service[120783]: request: DELETE /compute/v2.1/os-volumes/324b1753-7041-4704-b8b7-643ecdc20d61 HTTP/1.1 Aug 27 02:27:30.079157 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Accept: application/json Aug 27 02:27:30.079157 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Accept-Encoding: identity Aug 27 02:27:30.079157 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Connection: close Aug 27 02:27:30.079157 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Content-Length: 0 Aug 27 02:27:30.079157 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Content-Type: application/json Aug 27 02:27:30.079157 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Host: 10.222.0.61 Aug 27 02:27:30.079157 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Openstack-System-Scope: None Aug 27 02:27:30.079157 dv-cinder-846303-3-smb devstack@n-api.service[120783]: User-Agent: python-urllib3/1.26.11 Aug 27 02:27:30.079157 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Auth-Token: gAAAAABjCYERdVlydHI2nKDMXuHHbVsXRa3VOwX0BLeTN4KJuU6zmzeI1vxR6kV6GazZz13accilbQtATnDNKH1Dd48IhakUJzYlJnCRyI2aPV5xtdcXD9XGuYAnWqODkqh0CT6qdXQzOnytgsvTE8rh5AkQDmwcb3tCb-LsntAlYVGowr8JGdU Aug 27 02:27:30.079157 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Domain-Id: None Aug 27 02:27:30.079157 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Domain-Name: None Aug 27 02:27:30.079157 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Identity-Status: Confirmed Aug 27 02:27:30.079157 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Is-Admin-Project: True Aug 27 02:27:30.079157 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Project-Domain-Id: default Aug 27 02:27:30.079157 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Project-Domain-Name: Default Aug 27 02:27:30.079157 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Project-Id: 45415e2ac2d34e269d466de054b7597e Aug 27 02:27:30.079157 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Project-Name: tempest-VolumesNegativeTest-677531971 Aug 27 02:27:30.079157 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Role: member,reader Aug 27 02:27:30.079157 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Roles: member,reader Aug 27 02:27:30.081009 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/45415e2ac2d34e269d466de054b7597e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_45415e2ac2d34e269d466de054b7597e", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/45415e2ac2d34e269d466de054b7597e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/45415e2ac2d34e269d466de054b7597e"}]}] Aug 27 02:27:30.081009 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Tenant: tempest-VolumesNegativeTest-677531971 Aug 27 02:27:30.081009 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Tenant-Id: 45415e2ac2d34e269d466de054b7597e Aug 27 02:27:30.081009 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Tenant-Name: tempest-VolumesNegativeTest-677531971 Aug 27 02:27:30.081009 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User: tempest-VolumesNegativeTest-677531971-project Aug 27 02:27:30.081009 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User-Domain-Id: default Aug 27 02:27:30.081009 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User-Domain-Name: Default Aug 27 02:27:30.081009 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User-Id: 3cda8d65fcf344139bd3b6dd0df039a9 Aug 27 02:27:30.081009 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User-Name: tempest-VolumesNegativeTest-677531971-project Aug 27 02:27:30.081009 dv-cinder-846303-3-smb devstack@n-api.service[120783]: method: Aug 27 02:27:30.081009 dv-cinder-846303-3-smb devstack@n-api.service[120783]: exception: Volume 324b1753-7041-4704-b8b7-643ecdc20d61 could not be found. Aug 27 02:27:30.081009 dv-cinder-846303-3-smb devstack@n-api.service[120783]: action_args: {'id': '324b1753-7041-4704-b8b7-643ecdc20d61'} Aug 27 02:27:30.081009 dv-cinder-846303-3-smb devstack@n-api.service[120783]: {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:27:30.081876 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:30.081876 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 02:27:30.081876 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 02:27:30.081876 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 27 02:27:30.081876 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 27 02:27:30.081876 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 27 02:27:30.081876 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 27 02:27:30.081876 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 27 02:27:30.081876 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 27 02:27:30.081876 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 27 02:27:30.081876 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 27 02:27:30.081876 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 02:27:30.081876 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 02:27:30.081876 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 02:27:30.081876 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 02:27:30.081876 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 324b1753-7041-4704-b8b7-643ecdc20d61 could not be found. (HTTP 404) (Request-ID: req-51a2e21b-dac9-4fbd-8d19-962d5572faa9) Aug 27 02:27:30.081876 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:27:30.081876 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:27:30.081876 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:27:30.083019 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:30.083019 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 27 02:27:30.083019 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 27 02:27:30.083019 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 27 02:27:30.083019 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 27 02:27:30.083019 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 27 02:27:30.083019 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 27 02:27:30.083019 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 27 02:27:30.083019 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 27 02:27:30.083019 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 02:27:30.083019 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 02:27:30.083019 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 27 02:27:30.083019 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 27 02:27:30.083019 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 27 02:27:30.083019 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 27 02:27:30.083019 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 27 02:27:30.083019 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 27 02:27:30.083019 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 27 02:27:30.083019 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 27 02:27:30.084249 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 02:27:30.084249 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 02:27:30.084249 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 02:27:30.084249 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 02:27:30.084249 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 324b1753-7041-4704-b8b7-643ecdc20d61 could not be found. Aug 27 02:27:30.084249 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:27:30.084249 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:27:30.084249 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:27:30.084249 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:30.084249 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:27:30.084249 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:27:30.084249 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:27:30.084249 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:27:30.084249 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:27:30.084249 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:27:30.084249 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:27:30.084249 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:27:30.084249 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 27 02:27:30.084249 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:27:30.085376 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 324b1753-7041-4704-b8b7-643ecdc20d61 could not be found. Aug 27 02:27:30.085376 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:27:30.085376 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:27:30.085376 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:27:30.085376 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:30.085376 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:27:30.085376 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:27:30.085376 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:27:30.085376 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:27:30.085376 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 324b1753-7041-4704-b8b7-643ecdc20d61 could not be found. Aug 27 02:27:30.085376 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:27:30.085376 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-e7555bf4-ab6a-4bef-8ade-7b2929ce3fa3 tempest-VolumesNegativeTest-677531971 tempest-VolumesNegativeTest-677531971-project] Returning 404 to user: Volume 324b1753-7041-4704-b8b7-643ecdc20d61 could not be found. {{(pid=120783) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:27:30.085376 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-e7555bf4-ab6a-4bef-8ade-7b2929ce3fa3 tempest-VolumesNegativeTest-677531971 tempest-VolumesNegativeTest-677531971-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/324b1753-7041-4704-b8b7-643ecdc20d61" status: 404 len: 109 microversion: 2.1 time: 0.042774 Aug 27 02:27:30.085376 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 481/986] 10.222.0.61 () {58 vars in 1248 bytes} [Sat Aug 27 02:27:30 2022] DELETE /compute/v2.1/os-volumes/324b1753-7041-4704-b8b7-643ecdc20d61 => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:27:30.092498 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-9d248c94-28a5-4ec7-aa66-8a517a551503 tempest-VolumesNegativeTest-677531971 tempest-VolumesNegativeTest-677531971-project] Calling method '.version_select at 0x7fd8083d6310>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:30.132025 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.wsgi [None req-9d248c94-28a5-4ec7-aa66-8a517a551503 tempest-VolumesNegativeTest-677531971 tempest-VolumesNegativeTest-677531971-project] HTTP exception thrown: Volume ccf65315-da3b-4d5b-b502-bebaa756ba6b could not be found. Aug 27 02:27:30.134215 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-9d248c94-28a5-4ec7-aa66-8a517a551503 tempest-VolumesNegativeTest-677531971 tempest-VolumesNegativeTest-677531971-project] Request method failure captured: Aug 27 02:27:30.134215 dv-cinder-846303-3-smb devstack@n-api.service[120782]: request: GET /compute/v2.1/os-volumes/ccf65315-da3b-4d5b-b502-bebaa756ba6b HTTP/1.1 Aug 27 02:27:30.134215 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Accept: application/json Aug 27 02:27:30.134215 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Accept-Encoding: identity Aug 27 02:27:30.134215 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Connection: close Aug 27 02:27:30.134215 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Content-Length: 0 Aug 27 02:27:30.134215 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Content-Type: application/json Aug 27 02:27:30.134215 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Host: 10.222.0.61 Aug 27 02:27:30.134215 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Openstack-System-Scope: None Aug 27 02:27:30.134215 dv-cinder-846303-3-smb devstack@n-api.service[120782]: User-Agent: python-urllib3/1.26.11 Aug 27 02:27:30.134215 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Auth-Token: gAAAAABjCYERdVlydHI2nKDMXuHHbVsXRa3VOwX0BLeTN4KJuU6zmzeI1vxR6kV6GazZz13accilbQtATnDNKH1Dd48IhakUJzYlJnCRyI2aPV5xtdcXD9XGuYAnWqODkqh0CT6qdXQzOnytgsvTE8rh5AkQDmwcb3tCb-LsntAlYVGowr8JGdU Aug 27 02:27:30.134215 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Domain-Id: None Aug 27 02:27:30.134215 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Domain-Name: None Aug 27 02:27:30.134215 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Identity-Status: Confirmed Aug 27 02:27:30.134215 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Is-Admin-Project: True Aug 27 02:27:30.134215 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Domain-Id: default Aug 27 02:27:30.134215 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Domain-Name: Default Aug 27 02:27:30.134215 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Id: 45415e2ac2d34e269d466de054b7597e Aug 27 02:27:30.134215 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Name: tempest-VolumesNegativeTest-677531971 Aug 27 02:27:30.134215 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Role: member,reader Aug 27 02:27:30.134215 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Roles: member,reader Aug 27 02:27:30.135635 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/45415e2ac2d34e269d466de054b7597e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_45415e2ac2d34e269d466de054b7597e", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/45415e2ac2d34e269d466de054b7597e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/45415e2ac2d34e269d466de054b7597e"}]}] Aug 27 02:27:30.135635 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Tenant: tempest-VolumesNegativeTest-677531971 Aug 27 02:27:30.135635 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Tenant-Id: 45415e2ac2d34e269d466de054b7597e Aug 27 02:27:30.135635 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Tenant-Name: tempest-VolumesNegativeTest-677531971 Aug 27 02:27:30.135635 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User: tempest-VolumesNegativeTest-677531971-project Aug 27 02:27:30.135635 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Domain-Id: default Aug 27 02:27:30.135635 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Domain-Name: Default Aug 27 02:27:30.135635 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Id: 3cda8d65fcf344139bd3b6dd0df039a9 Aug 27 02:27:30.135635 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Name: tempest-VolumesNegativeTest-677531971-project Aug 27 02:27:30.135635 dv-cinder-846303-3-smb devstack@n-api.service[120782]: method: Aug 27 02:27:30.135635 dv-cinder-846303-3-smb devstack@n-api.service[120782]: exception: Volume ccf65315-da3b-4d5b-b502-bebaa756ba6b could not be found. Aug 27 02:27:30.135635 dv-cinder-846303-3-smb devstack@n-api.service[120782]: action_args: {'id': 'ccf65315-da3b-4d5b-b502-bebaa756ba6b'} Aug 27 02:27:30.135635 dv-cinder-846303-3-smb devstack@n-api.service[120782]: {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:27:30.136452 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:30.136452 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 02:27:30.136452 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 02:27:30.136452 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 27 02:27:30.136452 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 27 02:27:30.136452 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 27 02:27:30.136452 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 27 02:27:30.136452 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 27 02:27:30.136452 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 27 02:27:30.136452 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 27 02:27:30.136452 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 27 02:27:30.136452 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 02:27:30.136452 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 02:27:30.136452 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 02:27:30.136452 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 02:27:30.136452 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ccf65315-da3b-4d5b-b502-bebaa756ba6b could not be found. (HTTP 404) (Request-ID: req-0a1c2274-823a-4673-92c6-a9182517babe) Aug 27 02:27:30.136452 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:27:30.136452 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:27:30.136452 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:27:30.137675 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:30.137675 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 27 02:27:30.137675 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 27 02:27:30.137675 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 27 02:27:30.137675 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 27 02:27:30.137675 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 27 02:27:30.137675 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 27 02:27:30.137675 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 27 02:27:30.137675 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 27 02:27:30.137675 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 02:27:30.137675 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 02:27:30.137675 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 27 02:27:30.137675 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 27 02:27:30.137675 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 27 02:27:30.137675 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 27 02:27:30.137675 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 27 02:27:30.137675 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 27 02:27:30.137675 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 27 02:27:30.137675 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 27 02:27:30.138796 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 02:27:30.138796 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 02:27:30.138796 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 02:27:30.138796 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 02:27:30.138796 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ccf65315-da3b-4d5b-b502-bebaa756ba6b could not be found. Aug 27 02:27:30.138796 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:27:30.138796 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:27:30.138796 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:27:30.138796 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:30.138796 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:27:30.138796 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:27:30.138796 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:27:30.138796 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:27:30.138796 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:27:30.138796 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:27:30.138796 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:27:30.138796 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:27:30.138796 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 27 02:27:30.138796 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:27:30.140241 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ccf65315-da3b-4d5b-b502-bebaa756ba6b could not be found. Aug 27 02:27:30.140241 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:27:30.140241 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:27:30.140241 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:27:30.140241 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:30.140241 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:27:30.140241 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:27:30.140241 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:27:30.140241 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:27:30.140241 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ccf65315-da3b-4d5b-b502-bebaa756ba6b could not be found. Aug 27 02:27:30.140241 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:27:30.140241 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-9d248c94-28a5-4ec7-aa66-8a517a551503 tempest-VolumesNegativeTest-677531971 tempest-VolumesNegativeTest-677531971-project] Returning 404 to user: Volume ccf65315-da3b-4d5b-b502-bebaa756ba6b could not be found. {{(pid=120782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:27:30.140241 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-9d248c94-28a5-4ec7-aa66-8a517a551503 tempest-VolumesNegativeTest-677531971 tempest-VolumesNegativeTest-677531971-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/ccf65315-da3b-4d5b-b502-bebaa756ba6b" status: 404 len: 109 microversion: 2.1 time: 0.048089 Aug 27 02:27:30.140241 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 506/987] 10.222.0.61 () {58 vars in 1245 bytes} [Sat Aug 27 02:27:30 2022] GET /compute/v2.1/os-volumes/ccf65315-da3b-4d5b-b502-bebaa756ba6b => generated 109 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:27:30.641069 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-84732e55-3c55-407a-83f1-1130c6d3618b tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:30.643175 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-84732e55-3c55-407a-83f1-1130c6d3618b tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] [instance: 9fb59350-4f09-4e20-bddb-ffc9a65897b3] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:30.651672 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-84732e55-3c55-407a-83f1-1130c6d3618b tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:30.653778 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-84732e55-3c55-407a-83f1-1130c6d3618b tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:30.655113 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-84732e55-3c55-407a-83f1-1130c6d3618b tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:30.656136 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-84732e55-3c55-407a-83f1-1130c6d3618b tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:30.657357 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-84732e55-3c55-407a-83f1-1130c6d3618b tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:30.658130 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-84732e55-3c55-407a-83f1-1130c6d3618b tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:30.961142 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-84732e55-3c55-407a-83f1-1130c6d3618b tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f53d57f3544e5a25e1beeddab9af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2d4ae1c228446eb5bfc64d44348fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:30.971707 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-84732e55-3c55-407a-83f1-1130c6d3618b tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] 10.222.0.61 "GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3" status: 200 len: 1564 microversion: 2.1 time: 0.336238 Aug 27 02:27:30.972298 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 482/988] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:30 2022] GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3 => generated 1564 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:31.003319 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-d00bb60e-988e-4972-a05c-8137189275dc tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:31.003920 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-d00bb60e-988e-4972-a05c-8137189275dc tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 99f2f366-4776-427e-99cf-79399835f2c8] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:31.013260 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d00bb60e-988e-4972-a05c-8137189275dc tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:31.013764 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d00bb60e-988e-4972-a05c-8137189275dc tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:31.014645 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d00bb60e-988e-4972-a05c-8137189275dc tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:31.015402 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d00bb60e-988e-4972-a05c-8137189275dc tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:31.016211 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d00bb60e-988e-4972-a05c-8137189275dc tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:31.016869 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d00bb60e-988e-4972-a05c-8137189275dc tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:31.178264 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-d00bb60e-988e-4972-a05c-8137189275dc tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:31.188574 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-d00bb60e-988e-4972-a05c-8137189275dc tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:31.190885 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-d00bb60e-988e-4972-a05c-8137189275dc tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:31.192447 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-d00bb60e-988e-4972-a05c-8137189275dc tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8" status: 200 len: 1729 microversion: 2.20 time: 0.193341 Aug 27 02:27:31.193601 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 507/989] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:27:30 2022] GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8 => generated 1729 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:27:31.615483 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [req-5f0b465d-ac24-45a7-8f2a-b04d9310abbc req-fe69e8e0-7e84-4fbc-bbce-f9edf08d1ebe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99f2f366-4776-427e-99cf-79399835f2c8", "name": "network-vif-plugged", "status": "completed", "tag": "dc94d858-1637-4028-b898-2687b284cae7"}]} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:27:31.638816 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-5f0b465d-ac24-45a7-8f2a-b04d9310abbc req-fe69e8e0-7e84-4fbc-bbce-f9edf08d1ebe service nova] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:31.639701 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-5f0b465d-ac24-45a7-8f2a-b04d9310abbc req-fe69e8e0-7e84-4fbc-bbce-f9edf08d1ebe service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:31.640298 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-5f0b465d-ac24-45a7-8f2a-b04d9310abbc req-fe69e8e0-7e84-4fbc-bbce-f9edf08d1ebe service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:31.655544 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.compute.server_external_events [req-5f0b465d-ac24-45a7-8f2a-b04d9310abbc req-fe69e8e0-7e84-4fbc-bbce-f9edf08d1ebe service nova] Creating event network-vif-plugged:dc94d858-1637-4028-b898-2687b284cae7 for instance 99f2f366-4776-427e-99cf-79399835f2c8 on hv-cinder-84630 Aug 27 02:27:31.662429 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [req-5f0b465d-ac24-45a7-8f2a-b04d9310abbc req-fe69e8e0-7e84-4fbc-bbce-f9edf08d1ebe service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051346 Aug 27 02:27:31.664069 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 483/990] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Aug 27 02:27:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:27:32.217574 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-68889a97-7ba3-434c-beba-5fd4fb2aeb28 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:32.218492 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-68889a97-7ba3-434c-beba-5fd4fb2aeb28 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 99f2f366-4776-427e-99cf-79399835f2c8] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:32.224993 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-68889a97-7ba3-434c-beba-5fd4fb2aeb28 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:32.225673 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-68889a97-7ba3-434c-beba-5fd4fb2aeb28 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:32.226343 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-68889a97-7ba3-434c-beba-5fd4fb2aeb28 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:32.227135 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-68889a97-7ba3-434c-beba-5fd4fb2aeb28 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:32.228038 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-68889a97-7ba3-434c-beba-5fd4fb2aeb28 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:32.228542 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-68889a97-7ba3-434c-beba-5fd4fb2aeb28 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:32.387471 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-68889a97-7ba3-434c-beba-5fd4fb2aeb28 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:32.399206 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-68889a97-7ba3-434c-beba-5fd4fb2aeb28 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:32.400957 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-68889a97-7ba3-434c-beba-5fd4fb2aeb28 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:32.402372 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-68889a97-7ba3-434c-beba-5fd4fb2aeb28 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8" status: 200 len: 1729 microversion: 2.20 time: 0.189943 Aug 27 02:27:32.402977 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 484/991] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:27:32 2022] GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8 => generated 1729 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:27:32.458178 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-d2b1c494-8fde-4f6c-ad9d-21149dc9493f tempest-VolumesSnapshotsTestJSON-1891697078 tempest-VolumesSnapshotsTestJSON-1891697078-project] Action: 'create', calling method: .version_select at 0x7fd808408d30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-978927903"}} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:27:32.785179 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-d2b1c494-8fde-4f6c-ad9d-21149dc9493f tempest-VolumesSnapshotsTestJSON-1891697078 tempest-VolumesSnapshotsTestJSON-1891697078-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.587124 Aug 27 02:27:32.785686 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 508/992] 10.222.0.61 () {60 vars in 1155 bytes} [Sat Aug 27 02:27:32 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 588 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 27 02:27:32.798231 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-3835388f-a28e-4eb4-bc8a-5114f951dd86 tempest-VolumesSnapshotsTestJSON-1891697078 tempest-VolumesSnapshotsTestJSON-1891697078-project] Calling method '.version_select at 0x7fd8085a5e50>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:32.858239 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-3835388f-a28e-4eb4-bc8a-5114f951dd86 tempest-VolumesSnapshotsTestJSON-1891697078 tempest-VolumesSnapshotsTestJSON-1891697078-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/4447b692-ddd8-432f-90ac-f51662464309" status: 200 len: 344 microversion: 2.1 time: 0.063868 Aug 27 02:27:32.858814 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 485/993] 10.222.0.61 () {58 vars in 1245 bytes} [Sat Aug 27 02:27:32 2022] GET /compute/v2.1/os-volumes/4447b692-ddd8-432f-90ac-f51662464309 => generated 344 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:27:33.427642 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-d8e8660e-3d35-405c-a706-5c56aa64eb31 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:33.428269 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-d8e8660e-3d35-405c-a706-5c56aa64eb31 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 99f2f366-4776-427e-99cf-79399835f2c8] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:33.442061 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d8e8660e-3d35-405c-a706-5c56aa64eb31 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:33.442559 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d8e8660e-3d35-405c-a706-5c56aa64eb31 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:33.443001 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d8e8660e-3d35-405c-a706-5c56aa64eb31 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:33.443739 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d8e8660e-3d35-405c-a706-5c56aa64eb31 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:33.444199 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d8e8660e-3d35-405c-a706-5c56aa64eb31 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:33.444612 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d8e8660e-3d35-405c-a706-5c56aa64eb31 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:33.616579 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-d8e8660e-3d35-405c-a706-5c56aa64eb31 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:33.625952 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-d8e8660e-3d35-405c-a706-5c56aa64eb31 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:33.628278 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-d8e8660e-3d35-405c-a706-5c56aa64eb31 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:33.629954 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-d8e8660e-3d35-405c-a706-5c56aa64eb31 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8" status: 200 len: 1729 microversion: 2.20 time: 0.207742 Aug 27 02:27:33.630971 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 509/994] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:27:33 2022] GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8 => generated 1729 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:27:33.877691 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-bfd682ec-6e75-48d6-8ae8-44e60577ba49 tempest-VolumesSnapshotsTestJSON-1891697078 tempest-VolumesSnapshotsTestJSON-1891697078-project] Calling method '.version_select at 0x7fd80858e280>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:33.957110 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-bfd682ec-6e75-48d6-8ae8-44e60577ba49 tempest-VolumesSnapshotsTestJSON-1891697078 tempest-VolumesSnapshotsTestJSON-1891697078-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/4447b692-ddd8-432f-90ac-f51662464309" status: 200 len: 345 microversion: 2.1 time: 0.087540 Aug 27 02:27:33.957730 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 486/995] 10.222.0.61 () {58 vars in 1245 bytes} [Sat Aug 27 02:27:33 2022] GET /compute/v2.1/os-volumes/4447b692-ddd8-432f-90ac-f51662464309 => generated 345 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:27:33.970579 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-dabed379-3419-4c24-98e6-1d575df4d1fc tempest-VolumesSnapshotsTestJSON-1891697078 tempest-VolumesSnapshotsTestJSON-1891697078-project] Action: 'create', calling method: .version_select at 0x7fd808560e50>, body: {"snapshot": {"volume_id": "4447b692-ddd8-432f-90ac-f51662464309", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-548584812"}} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:27:34.170846 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-dabed379-3419-4c24-98e6-1d575df4d1fc tempest-VolumesSnapshotsTestJSON-1891697078 tempest-VolumesSnapshotsTestJSON-1891697078-project] 10.222.0.61 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.196342 Aug 27 02:27:34.170846 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 510/996] 10.222.0.61 () {60 vars in 1162 bytes} [Sat Aug 27 02:27:33 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:27:34.177907 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-6badfdcb-e3e1-4bb0-9be2-f77768ad0606 tempest-VolumesSnapshotsTestJSON-1891697078 tempest-VolumesSnapshotsTestJSON-1891697078-project] Calling method '.version_select at 0x7fd8085271f0>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:34.225083 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-6badfdcb-e3e1-4bb0-9be2-f77768ad0606 tempest-VolumesSnapshotsTestJSON-1891697078 tempest-VolumesSnapshotsTestJSON-1891697078-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/11c21c17-4440-4f27-b9ee-c307cc02fa6d" status: 200 len: 286 microversion: 2.1 time: 0.053292 Aug 27 02:27:34.226196 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 487/997] 10.222.0.61 () {58 vars in 1251 bytes} [Sat Aug 27 02:27:34 2022] GET /compute/v2.1/os-snapshots/11c21c17-4440-4f27-b9ee-c307cc02fa6d => generated 286 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:27:34.242657 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-2b0e500c-6988-4010-a8b0-974ddd0d3465 tempest-VolumesSnapshotsTestJSON-1891697078 tempest-VolumesSnapshotsTestJSON-1891697078-project] Calling method '.version_select at 0x7fd808681670>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:34.282115 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-2b0e500c-6988-4010-a8b0-974ddd0d3465 tempest-VolumesSnapshotsTestJSON-1891697078 tempest-VolumesSnapshotsTestJSON-1891697078-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.044192 Aug 27 02:27:34.282585 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 511/998] 10.222.0.61 () {58 vars in 1140 bytes} [Sat Aug 27 02:27:34 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:27:34.294885 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-b19ea983-f4d5-4a9f-b104-53d81e2ff338 tempest-VolumesSnapshotsTestJSON-1891697078 tempest-VolumesSnapshotsTestJSON-1891697078-project] Calling method '.version_select at 0x7fd8084f3f70>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:34.353850 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-b19ea983-f4d5-4a9f-b104-53d81e2ff338 tempest-VolumesSnapshotsTestJSON-1891697078 tempest-VolumesSnapshotsTestJSON-1891697078-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/11c21c17-4440-4f27-b9ee-c307cc02fa6d" status: 200 len: 286 microversion: 2.1 time: 0.063070 Aug 27 02:27:34.363025 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 488/999] 10.222.0.61 () {58 vars in 1251 bytes} [Sat Aug 27 02:27:34 2022] GET /compute/v2.1/os-snapshots/11c21c17-4440-4f27-b9ee-c307cc02fa6d => generated 286 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:27:34.672631 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-b8812bce-197b-4f5f-a44f-3c00b47a324d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:34.673445 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-b8812bce-197b-4f5f-a44f-3c00b47a324d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 99f2f366-4776-427e-99cf-79399835f2c8] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:34.681043 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b8812bce-197b-4f5f-a44f-3c00b47a324d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:34.681629 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b8812bce-197b-4f5f-a44f-3c00b47a324d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:34.682066 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b8812bce-197b-4f5f-a44f-3c00b47a324d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:34.682785 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b8812bce-197b-4f5f-a44f-3c00b47a324d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:34.683261 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b8812bce-197b-4f5f-a44f-3c00b47a324d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:34.684003 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b8812bce-197b-4f5f-a44f-3c00b47a324d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:34.878050 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-b8812bce-197b-4f5f-a44f-3c00b47a324d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:34.887920 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-b8812bce-197b-4f5f-a44f-3c00b47a324d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:34.889899 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-b8812bce-197b-4f5f-a44f-3c00b47a324d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:34.891578 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-b8812bce-197b-4f5f-a44f-3c00b47a324d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8" status: 200 len: 1716 microversion: 2.20 time: 0.224873 Aug 27 02:27:34.892254 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 512/1000] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:27:34 2022] GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8 => generated 1716 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:27:35.371677 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-3750e12a-ff25-4b5c-aba0-54500b85156b tempest-VolumesSnapshotsTestJSON-1891697078 tempest-VolumesSnapshotsTestJSON-1891697078-project] Calling method '.version_select at 0x7fd8085a5310>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:35.407368 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-3750e12a-ff25-4b5c-aba0-54500b85156b tempest-VolumesSnapshotsTestJSON-1891697078 tempest-VolumesSnapshotsTestJSON-1891697078-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/11c21c17-4440-4f27-b9ee-c307cc02fa6d" status: 200 len: 287 microversion: 2.1 time: 0.040115 Aug 27 02:27:35.408041 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 489/1001] 10.222.0.61 () {58 vars in 1251 bytes} [Sat Aug 27 02:27:35 2022] GET /compute/v2.1/os-snapshots/11c21c17-4440-4f27-b9ee-c307cc02fa6d => generated 287 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:27:35.419934 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-dafedbf0-29b9-46e0-b007-ae73774d7ed0 tempest-VolumesSnapshotsTestJSON-1891697078 tempest-VolumesSnapshotsTestJSON-1891697078-project] Calling method '.version_select at 0x7fd8085cb5e0>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:35.498045 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-dafedbf0-29b9-46e0-b007-ae73774d7ed0 tempest-VolumesSnapshotsTestJSON-1891697078 tempest-VolumesSnapshotsTestJSON-1891697078-project] 10.222.0.61 "DELETE /compute/v2.1/os-snapshots/11c21c17-4440-4f27-b9ee-c307cc02fa6d" status: 202 len: 0 microversion: 2.1 time: 0.082152 Aug 27 02:27:35.499143 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 513/1002] 10.222.0.61 () {58 vars in 1254 bytes} [Sat Aug 27 02:27:35 2022] DELETE /compute/v2.1/os-snapshots/11c21c17-4440-4f27-b9ee-c307cc02fa6d => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:27:35.509037 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-f16eec60-80c3-4020-a3de-ada25bcd6590 tempest-VolumesSnapshotsTestJSON-1891697078 tempest-VolumesSnapshotsTestJSON-1891697078-project] Calling method '.version_select at 0x7fd8085e9430>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:35.544539 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-f16eec60-80c3-4020-a3de-ada25bcd6590 tempest-VolumesSnapshotsTestJSON-1891697078 tempest-VolumesSnapshotsTestJSON-1891697078-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/11c21c17-4440-4f27-b9ee-c307cc02fa6d" status: 200 len: 286 microversion: 2.1 time: 0.040159 Aug 27 02:27:35.545108 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 490/1003] 10.222.0.61 () {58 vars in 1251 bytes} [Sat Aug 27 02:27:35 2022] GET /compute/v2.1/os-snapshots/11c21c17-4440-4f27-b9ee-c307cc02fa6d => generated 286 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:27:36.564640 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-ada2043d-42a2-443f-bf66-8c181c1dac90 tempest-VolumesSnapshotsTestJSON-1891697078 tempest-VolumesSnapshotsTestJSON-1891697078-project] Calling method '.version_select at 0x7fd8083d64c0>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:36.604770 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.wsgi [None req-ada2043d-42a2-443f-bf66-8c181c1dac90 tempest-VolumesSnapshotsTestJSON-1891697078 tempest-VolumesSnapshotsTestJSON-1891697078-project] HTTP exception thrown: Snapshot 11c21c17-4440-4f27-b9ee-c307cc02fa6d could not be found. Aug 27 02:27:36.607750 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-ada2043d-42a2-443f-bf66-8c181c1dac90 tempest-VolumesSnapshotsTestJSON-1891697078 tempest-VolumesSnapshotsTestJSON-1891697078-project] Request method failure captured: Aug 27 02:27:36.607750 dv-cinder-846303-3-smb devstack@n-api.service[120782]: request: GET /compute/v2.1/os-snapshots/11c21c17-4440-4f27-b9ee-c307cc02fa6d HTTP/1.1 Aug 27 02:27:36.607750 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Accept: application/json Aug 27 02:27:36.607750 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Accept-Encoding: identity Aug 27 02:27:36.607750 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Connection: close Aug 27 02:27:36.607750 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Content-Length: 0 Aug 27 02:27:36.607750 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Content-Type: application/json Aug 27 02:27:36.607750 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Host: 10.222.0.61 Aug 27 02:27:36.607750 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Openstack-System-Scope: None Aug 27 02:27:36.607750 dv-cinder-846303-3-smb devstack@n-api.service[120782]: User-Agent: python-urllib3/1.26.11 Aug 27 02:27:36.607750 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Auth-Token: gAAAAABjCYEUfSwnpfRPcvTxXv2P4F8KICsUgq50dY4qFxSq7bw9xnmciVPE-RIwEes---lANhhfuBY6EcXKx9Y094JY5Cr4J8Px64zcgudIVih0l_mr1PQaIW0Di0ThGMQfK_QjJrUg3Mbo1OP6k6gUtJz_Clr61dWgbn6_Yo7F7Yw9j87PQIQ Aug 27 02:27:36.607750 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Domain-Id: None Aug 27 02:27:36.607750 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Domain-Name: None Aug 27 02:27:36.607750 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Identity-Status: Confirmed Aug 27 02:27:36.607750 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Is-Admin-Project: True Aug 27 02:27:36.607750 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Domain-Id: default Aug 27 02:27:36.607750 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Domain-Name: Default Aug 27 02:27:36.607750 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Id: 8fba1fce5d474fecbb363f4175ef04ba Aug 27 02:27:36.607750 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1891697078 Aug 27 02:27:36.607750 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Role: member,reader Aug 27 02:27:36.607750 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Roles: member,reader Aug 27 02:27:36.611827 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/8fba1fce5d474fecbb363f4175ef04ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_8fba1fce5d474fecbb363f4175ef04ba", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8fba1fce5d474fecbb363f4175ef04ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8fba1fce5d474fecbb363f4175ef04ba"}]}] Aug 27 02:27:36.611827 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1891697078 Aug 27 02:27:36.611827 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Tenant-Id: 8fba1fce5d474fecbb363f4175ef04ba Aug 27 02:27:36.611827 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1891697078 Aug 27 02:27:36.611827 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User: tempest-VolumesSnapshotsTestJSON-1891697078-project Aug 27 02:27:36.611827 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Domain-Id: default Aug 27 02:27:36.611827 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Domain-Name: Default Aug 27 02:27:36.611827 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Id: d68b91da474448089739770f13901c13 Aug 27 02:27:36.611827 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1891697078-project Aug 27 02:27:36.611827 dv-cinder-846303-3-smb devstack@n-api.service[120782]: method: Aug 27 02:27:36.611827 dv-cinder-846303-3-smb devstack@n-api.service[120782]: exception: Snapshot 11c21c17-4440-4f27-b9ee-c307cc02fa6d could not be found. Aug 27 02:27:36.611827 dv-cinder-846303-3-smb devstack@n-api.service[120782]: action_args: {'id': '11c21c17-4440-4f27-b9ee-c307cc02fa6d'} Aug 27 02:27:36.611827 dv-cinder-846303-3-smb devstack@n-api.service[120782]: {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:27:36.613681 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:36.613681 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 27 02:27:36.613681 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 27 02:27:36.613681 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 27 02:27:36.613681 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 27 02:27:36.613681 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 27 02:27:36.613681 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 27 02:27:36.613681 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 27 02:27:36.613681 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 27 02:27:36.613681 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 27 02:27:36.613681 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 27 02:27:36.613681 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 02:27:36.613681 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 02:27:36.613681 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 02:27:36.613681 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 02:27:36.613681 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 11c21c17-4440-4f27-b9ee-c307cc02fa6d could not be found. (HTTP 404) (Request-ID: req-60bf5629-78b3-4f73-91e4-4b5bc8364c68) Aug 27 02:27:36.613681 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:27:36.613681 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:27:36.615572 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:27:36.615572 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:36.615572 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 27 02:27:36.615572 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 27 02:27:36.615572 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 27 02:27:36.615572 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 27 02:27:36.615572 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 27 02:27:36.615572 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 27 02:27:36.615572 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 27 02:27:36.615572 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 27 02:27:36.615572 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 27 02:27:36.615572 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 27 02:27:36.615572 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 27 02:27:36.615572 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 27 02:27:36.615572 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 27 02:27:36.615572 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 27 02:27:36.615572 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 27 02:27:36.615572 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 27 02:27:36.615572 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 27 02:27:36.616738 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 27 02:27:36.616738 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 02:27:36.616738 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 02:27:36.616738 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 02:27:36.616738 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 02:27:36.616738 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 11c21c17-4440-4f27-b9ee-c307cc02fa6d could not be found. Aug 27 02:27:36.616738 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:27:36.616738 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:27:36.616738 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:27:36.616738 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:36.616738 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:27:36.616738 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:27:36.616738 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:27:36.616738 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:27:36.616738 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:27:36.616738 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:27:36.616738 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:27:36.616738 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:27:36.616738 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 27 02:27:36.616738 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:27:36.618074 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 11c21c17-4440-4f27-b9ee-c307cc02fa6d could not be found. Aug 27 02:27:36.618074 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:27:36.618074 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:27:36.618074 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:27:36.618074 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:36.618074 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:27:36.618074 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:27:36.618074 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:27:36.618074 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:27:36.618074 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 11c21c17-4440-4f27-b9ee-c307cc02fa6d could not be found. Aug 27 02:27:36.618074 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:27:36.618074 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-ada2043d-42a2-443f-bf66-8c181c1dac90 tempest-VolumesSnapshotsTestJSON-1891697078 tempest-VolumesSnapshotsTestJSON-1891697078-project] Returning 404 to user: Snapshot 11c21c17-4440-4f27-b9ee-c307cc02fa6d could not be found. {{(pid=120782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:27:36.618074 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-ada2043d-42a2-443f-bf66-8c181c1dac90 tempest-VolumesSnapshotsTestJSON-1891697078 tempest-VolumesSnapshotsTestJSON-1891697078-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/11c21c17-4440-4f27-b9ee-c307cc02fa6d" status: 404 len: 111 microversion: 2.1 time: 0.056266 Aug 27 02:27:36.618947 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 514/1004] 10.222.0.61 () {58 vars in 1251 bytes} [Sat Aug 27 02:27:36 2022] GET /compute/v2.1/os-snapshots/11c21c17-4440-4f27-b9ee-c307cc02fa6d => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:27:36.629284 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-26f0a0bf-5c12-4a15-8cda-fef1c3abf23b tempest-VolumesSnapshotsTestJSON-1891697078 tempest-VolumesSnapshotsTestJSON-1891697078-project] Calling method '.version_select at 0x7fd8084f3790>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:36.720090 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-26f0a0bf-5c12-4a15-8cda-fef1c3abf23b tempest-VolumesSnapshotsTestJSON-1891697078 tempest-VolumesSnapshotsTestJSON-1891697078-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/4447b692-ddd8-432f-90ac-f51662464309" status: 202 len: 0 microversion: 2.1 time: 0.098836 Aug 27 02:27:36.721146 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 491/1005] 10.222.0.61 () {58 vars in 1248 bytes} [Sat Aug 27 02:27:36 2022] DELETE /compute/v2.1/os-volumes/4447b692-ddd8-432f-90ac-f51662464309 => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:27:36.733693 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-565cae4e-69aa-4e48-98ad-204fb06cc386 tempest-VolumesSnapshotsTestJSON-1891697078 tempest-VolumesSnapshotsTestJSON-1891697078-project] Calling method '.version_select at 0x7fd808408c10>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:36.819637 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-565cae4e-69aa-4e48-98ad-204fb06cc386 tempest-VolumesSnapshotsTestJSON-1891697078 tempest-VolumesSnapshotsTestJSON-1891697078-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/4447b692-ddd8-432f-90ac-f51662464309" status: 200 len: 344 microversion: 2.1 time: 0.091756 Aug 27 02:27:36.820260 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 515/1006] 10.222.0.61 () {58 vars in 1245 bytes} [Sat Aug 27 02:27:36 2022] GET /compute/v2.1/os-volumes/4447b692-ddd8-432f-90ac-f51662464309 => generated 344 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:27:37.842184 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-4e81c1ad-e145-44a1-9bf2-da136b2da3b7 tempest-VolumesSnapshotsTestJSON-1891697078 tempest-VolumesSnapshotsTestJSON-1891697078-project] Calling method '.version_select at 0x7fd8085a58b0>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:37.877088 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.wsgi [None req-4e81c1ad-e145-44a1-9bf2-da136b2da3b7 tempest-VolumesSnapshotsTestJSON-1891697078 tempest-VolumesSnapshotsTestJSON-1891697078-project] HTTP exception thrown: Volume 4447b692-ddd8-432f-90ac-f51662464309 could not be found. Aug 27 02:27:37.879886 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-4e81c1ad-e145-44a1-9bf2-da136b2da3b7 tempest-VolumesSnapshotsTestJSON-1891697078 tempest-VolumesSnapshotsTestJSON-1891697078-project] Request method failure captured: Aug 27 02:27:37.879886 dv-cinder-846303-3-smb devstack@n-api.service[120783]: request: GET /compute/v2.1/os-volumes/4447b692-ddd8-432f-90ac-f51662464309 HTTP/1.1 Aug 27 02:27:37.879886 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Accept: application/json Aug 27 02:27:37.879886 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Accept-Encoding: identity Aug 27 02:27:37.879886 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Connection: close Aug 27 02:27:37.879886 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Content-Length: 0 Aug 27 02:27:37.879886 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Content-Type: application/json Aug 27 02:27:37.879886 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Host: 10.222.0.61 Aug 27 02:27:37.879886 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Openstack-System-Scope: None Aug 27 02:27:37.879886 dv-cinder-846303-3-smb devstack@n-api.service[120783]: User-Agent: python-urllib3/1.26.11 Aug 27 02:27:37.879886 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Auth-Token: gAAAAABjCYEUfSwnpfRPcvTxXv2P4F8KICsUgq50dY4qFxSq7bw9xnmciVPE-RIwEes---lANhhfuBY6EcXKx9Y094JY5Cr4J8Px64zcgudIVih0l_mr1PQaIW0Di0ThGMQfK_QjJrUg3Mbo1OP6k6gUtJz_Clr61dWgbn6_Yo7F7Yw9j87PQIQ Aug 27 02:27:37.879886 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Domain-Id: None Aug 27 02:27:37.879886 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Domain-Name: None Aug 27 02:27:37.879886 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Identity-Status: Confirmed Aug 27 02:27:37.879886 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Is-Admin-Project: True Aug 27 02:27:37.879886 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Project-Domain-Id: default Aug 27 02:27:37.879886 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Project-Domain-Name: Default Aug 27 02:27:37.879886 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Project-Id: 8fba1fce5d474fecbb363f4175ef04ba Aug 27 02:27:37.879886 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1891697078 Aug 27 02:27:37.879886 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Role: member,reader Aug 27 02:27:37.879886 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Roles: member,reader Aug 27 02:27:37.881963 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/8fba1fce5d474fecbb363f4175ef04ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_8fba1fce5d474fecbb363f4175ef04ba", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8fba1fce5d474fecbb363f4175ef04ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8fba1fce5d474fecbb363f4175ef04ba"}]}] Aug 27 02:27:37.881963 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1891697078 Aug 27 02:27:37.881963 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Tenant-Id: 8fba1fce5d474fecbb363f4175ef04ba Aug 27 02:27:37.881963 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1891697078 Aug 27 02:27:37.881963 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User: tempest-VolumesSnapshotsTestJSON-1891697078-project Aug 27 02:27:37.881963 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User-Domain-Id: default Aug 27 02:27:37.881963 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User-Domain-Name: Default Aug 27 02:27:37.881963 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User-Id: d68b91da474448089739770f13901c13 Aug 27 02:27:37.881963 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1891697078-project Aug 27 02:27:37.881963 dv-cinder-846303-3-smb devstack@n-api.service[120783]: method: Aug 27 02:27:37.881963 dv-cinder-846303-3-smb devstack@n-api.service[120783]: exception: Volume 4447b692-ddd8-432f-90ac-f51662464309 could not be found. Aug 27 02:27:37.881963 dv-cinder-846303-3-smb devstack@n-api.service[120783]: action_args: {'id': '4447b692-ddd8-432f-90ac-f51662464309'} Aug 27 02:27:37.881963 dv-cinder-846303-3-smb devstack@n-api.service[120783]: {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:27:37.883333 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:37.883333 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 02:27:37.883333 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 02:27:37.883333 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 27 02:27:37.883333 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 27 02:27:37.883333 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 27 02:27:37.883333 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 27 02:27:37.883333 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 27 02:27:37.883333 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 27 02:27:37.883333 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 27 02:27:37.883333 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 27 02:27:37.883333 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 02:27:37.883333 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 02:27:37.883333 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 02:27:37.883333 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 02:27:37.883333 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4447b692-ddd8-432f-90ac-f51662464309 could not be found. (HTTP 404) (Request-ID: req-4d12b73a-5ab1-4ee7-84d1-4fa5aeabff66) Aug 27 02:27:37.883333 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:27:37.883333 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:27:37.883333 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:27:37.885295 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:37.885295 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 27 02:27:37.885295 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 27 02:27:37.885295 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 27 02:27:37.885295 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 27 02:27:37.885295 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 27 02:27:37.885295 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 27 02:27:37.885295 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 27 02:27:37.885295 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 27 02:27:37.885295 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 02:27:37.885295 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 02:27:37.885295 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 27 02:27:37.885295 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 27 02:27:37.885295 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 27 02:27:37.885295 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 27 02:27:37.885295 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 27 02:27:37.885295 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 27 02:27:37.885295 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 27 02:27:37.885295 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 27 02:27:37.887417 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 02:27:37.887417 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 02:27:37.887417 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 02:27:37.887417 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 02:27:37.887417 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4447b692-ddd8-432f-90ac-f51662464309 could not be found. Aug 27 02:27:37.887417 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:27:37.887417 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:27:37.887417 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:27:37.887417 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:37.887417 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:27:37.887417 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:27:37.887417 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:27:37.887417 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:27:37.887417 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:27:37.887417 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:27:37.887417 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:27:37.887417 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:27:37.887417 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 27 02:27:37.887417 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:27:37.892413 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4447b692-ddd8-432f-90ac-f51662464309 could not be found. Aug 27 02:27:37.892413 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:27:37.892413 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:27:37.892413 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:27:37.892413 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:37.892413 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:27:37.892413 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:27:37.892413 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:27:37.892413 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:27:37.892413 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4447b692-ddd8-432f-90ac-f51662464309 could not be found. Aug 27 02:27:37.892413 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:27:37.892413 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-4e81c1ad-e145-44a1-9bf2-da136b2da3b7 tempest-VolumesSnapshotsTestJSON-1891697078 tempest-VolumesSnapshotsTestJSON-1891697078-project] Returning 404 to user: Volume 4447b692-ddd8-432f-90ac-f51662464309 could not be found. {{(pid=120783) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:27:37.892413 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-4e81c1ad-e145-44a1-9bf2-da136b2da3b7 tempest-VolumesSnapshotsTestJSON-1891697078 tempest-VolumesSnapshotsTestJSON-1891697078-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/4447b692-ddd8-432f-90ac-f51662464309" status: 404 len: 109 microversion: 2.1 time: 0.045090 Aug 27 02:27:37.892413 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 492/1007] 10.222.0.61 () {58 vars in 1245 bytes} [Sat Aug 27 02:27:37 2022] GET /compute/v2.1/os-volumes/4447b692-ddd8-432f-90ac-f51662464309 => generated 109 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:27:37.897880 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-97a1dcdc-6454-46f4-a0ad-98f8a9f5a27b tempest-VolumesSnapshotsTestJSON-1891697078 tempest-VolumesSnapshotsTestJSON-1891697078-project] Calling method '.version_select at 0x7fd80832e550>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:37.931255 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.wsgi [None req-97a1dcdc-6454-46f4-a0ad-98f8a9f5a27b tempest-VolumesSnapshotsTestJSON-1891697078 tempest-VolumesSnapshotsTestJSON-1891697078-project] HTTP exception thrown: Volume 4447b692-ddd8-432f-90ac-f51662464309 could not be found. Aug 27 02:27:37.933277 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-97a1dcdc-6454-46f4-a0ad-98f8a9f5a27b tempest-VolumesSnapshotsTestJSON-1891697078 tempest-VolumesSnapshotsTestJSON-1891697078-project] Request method failure captured: Aug 27 02:27:37.933277 dv-cinder-846303-3-smb devstack@n-api.service[120782]: request: DELETE /compute/v2.1/os-volumes/4447b692-ddd8-432f-90ac-f51662464309 HTTP/1.1 Aug 27 02:27:37.933277 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Accept: application/json Aug 27 02:27:37.933277 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Accept-Encoding: identity Aug 27 02:27:37.933277 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Connection: close Aug 27 02:27:37.933277 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Content-Length: 0 Aug 27 02:27:37.933277 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Content-Type: application/json Aug 27 02:27:37.933277 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Host: 10.222.0.61 Aug 27 02:27:37.933277 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Openstack-System-Scope: None Aug 27 02:27:37.933277 dv-cinder-846303-3-smb devstack@n-api.service[120782]: User-Agent: python-urllib3/1.26.11 Aug 27 02:27:37.933277 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Auth-Token: gAAAAABjCYEUfSwnpfRPcvTxXv2P4F8KICsUgq50dY4qFxSq7bw9xnmciVPE-RIwEes---lANhhfuBY6EcXKx9Y094JY5Cr4J8Px64zcgudIVih0l_mr1PQaIW0Di0ThGMQfK_QjJrUg3Mbo1OP6k6gUtJz_Clr61dWgbn6_Yo7F7Yw9j87PQIQ Aug 27 02:27:37.933277 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Domain-Id: None Aug 27 02:27:37.933277 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Domain-Name: None Aug 27 02:27:37.933277 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Identity-Status: Confirmed Aug 27 02:27:37.933277 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Is-Admin-Project: True Aug 27 02:27:37.933277 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Domain-Id: default Aug 27 02:27:37.933277 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Domain-Name: Default Aug 27 02:27:37.933277 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Id: 8fba1fce5d474fecbb363f4175ef04ba Aug 27 02:27:37.933277 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1891697078 Aug 27 02:27:37.933277 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Role: member,reader Aug 27 02:27:37.933277 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Roles: member,reader Aug 27 02:27:37.936086 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/8fba1fce5d474fecbb363f4175ef04ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_8fba1fce5d474fecbb363f4175ef04ba", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8fba1fce5d474fecbb363f4175ef04ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8fba1fce5d474fecbb363f4175ef04ba"}]}] Aug 27 02:27:37.936086 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1891697078 Aug 27 02:27:37.936086 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Tenant-Id: 8fba1fce5d474fecbb363f4175ef04ba Aug 27 02:27:37.936086 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1891697078 Aug 27 02:27:37.936086 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User: tempest-VolumesSnapshotsTestJSON-1891697078-project Aug 27 02:27:37.936086 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Domain-Id: default Aug 27 02:27:37.936086 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Domain-Name: Default Aug 27 02:27:37.936086 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Id: d68b91da474448089739770f13901c13 Aug 27 02:27:37.936086 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1891697078-project Aug 27 02:27:37.936086 dv-cinder-846303-3-smb devstack@n-api.service[120782]: method: Aug 27 02:27:37.936086 dv-cinder-846303-3-smb devstack@n-api.service[120782]: exception: Volume 4447b692-ddd8-432f-90ac-f51662464309 could not be found. Aug 27 02:27:37.936086 dv-cinder-846303-3-smb devstack@n-api.service[120782]: action_args: {'id': '4447b692-ddd8-432f-90ac-f51662464309'} Aug 27 02:27:37.936086 dv-cinder-846303-3-smb devstack@n-api.service[120782]: {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:27:37.937418 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:37.937418 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 02:27:37.937418 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 02:27:37.937418 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 27 02:27:37.937418 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 27 02:27:37.937418 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 27 02:27:37.937418 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 27 02:27:37.937418 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 27 02:27:37.937418 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 27 02:27:37.937418 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 27 02:27:37.937418 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 27 02:27:37.937418 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 02:27:37.937418 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 02:27:37.937418 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 02:27:37.937418 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 02:27:37.937418 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4447b692-ddd8-432f-90ac-f51662464309 could not be found. (HTTP 404) (Request-ID: req-28def95a-f6fc-462b-8fe8-490abd6f9df3) Aug 27 02:27:37.937418 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:27:37.937418 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:27:37.937418 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:27:37.939881 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:37.939881 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 27 02:27:37.939881 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 27 02:27:37.939881 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 27 02:27:37.939881 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 27 02:27:37.939881 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 27 02:27:37.939881 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 27 02:27:37.939881 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 27 02:27:37.939881 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 27 02:27:37.939881 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 02:27:37.939881 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 02:27:37.939881 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 27 02:27:37.939881 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 27 02:27:37.939881 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 27 02:27:37.939881 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 27 02:27:37.939881 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 27 02:27:37.939881 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 27 02:27:37.939881 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 27 02:27:37.939881 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 27 02:27:37.941559 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 02:27:37.941559 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 02:27:37.941559 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 02:27:37.941559 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 02:27:37.941559 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4447b692-ddd8-432f-90ac-f51662464309 could not be found. Aug 27 02:27:37.941559 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:27:37.941559 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:27:37.941559 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:27:37.941559 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:37.941559 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:27:37.941559 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:27:37.941559 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:27:37.941559 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:27:37.941559 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:27:37.941559 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:27:37.941559 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:27:37.941559 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:27:37.941559 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 27 02:27:37.941559 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:27:37.943772 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4447b692-ddd8-432f-90ac-f51662464309 could not be found. Aug 27 02:27:37.943772 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:27:37.943772 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:27:37.943772 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:27:37.943772 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:37.943772 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:27:37.943772 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:27:37.943772 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:27:37.943772 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:27:37.943772 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4447b692-ddd8-432f-90ac-f51662464309 could not be found. Aug 27 02:27:37.943772 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:27:37.943772 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-97a1dcdc-6454-46f4-a0ad-98f8a9f5a27b tempest-VolumesSnapshotsTestJSON-1891697078 tempest-VolumesSnapshotsTestJSON-1891697078-project] Returning 404 to user: Volume 4447b692-ddd8-432f-90ac-f51662464309 could not be found. {{(pid=120782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:27:37.943772 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-97a1dcdc-6454-46f4-a0ad-98f8a9f5a27b tempest-VolumesSnapshotsTestJSON-1891697078 tempest-VolumesSnapshotsTestJSON-1891697078-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/4447b692-ddd8-432f-90ac-f51662464309" status: 404 len: 109 microversion: 2.1 time: 0.041667 Aug 27 02:27:37.945338 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 516/1008] 10.222.0.61 () {58 vars in 1248 bytes} [Sat Aug 27 02:27:37 2022] DELETE /compute/v2.1/os-volumes/4447b692-ddd8-432f-90ac-f51662464309 => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:27:37.945496 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-7a68f445-1316-41ef-a3a6-0f18b03694c0 tempest-VolumesSnapshotsTestJSON-1891697078 tempest-VolumesSnapshotsTestJSON-1891697078-project] Calling method '.version_select at 0x7fd80858e280>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:37.978005 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.wsgi [None req-7a68f445-1316-41ef-a3a6-0f18b03694c0 tempest-VolumesSnapshotsTestJSON-1891697078 tempest-VolumesSnapshotsTestJSON-1891697078-project] HTTP exception thrown: Volume 4447b692-ddd8-432f-90ac-f51662464309 could not be found. Aug 27 02:27:37.980202 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-7a68f445-1316-41ef-a3a6-0f18b03694c0 tempest-VolumesSnapshotsTestJSON-1891697078 tempest-VolumesSnapshotsTestJSON-1891697078-project] Request method failure captured: Aug 27 02:27:37.980202 dv-cinder-846303-3-smb devstack@n-api.service[120783]: request: GET /compute/v2.1/os-volumes/4447b692-ddd8-432f-90ac-f51662464309 HTTP/1.1 Aug 27 02:27:37.980202 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Accept: application/json Aug 27 02:27:37.980202 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Accept-Encoding: identity Aug 27 02:27:37.980202 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Connection: close Aug 27 02:27:37.980202 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Content-Length: 0 Aug 27 02:27:37.980202 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Content-Type: application/json Aug 27 02:27:37.980202 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Host: 10.222.0.61 Aug 27 02:27:37.980202 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Openstack-System-Scope: None Aug 27 02:27:37.980202 dv-cinder-846303-3-smb devstack@n-api.service[120783]: User-Agent: python-urllib3/1.26.11 Aug 27 02:27:37.980202 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Auth-Token: gAAAAABjCYEUfSwnpfRPcvTxXv2P4F8KICsUgq50dY4qFxSq7bw9xnmciVPE-RIwEes---lANhhfuBY6EcXKx9Y094JY5Cr4J8Px64zcgudIVih0l_mr1PQaIW0Di0ThGMQfK_QjJrUg3Mbo1OP6k6gUtJz_Clr61dWgbn6_Yo7F7Yw9j87PQIQ Aug 27 02:27:37.980202 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Domain-Id: None Aug 27 02:27:37.980202 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Domain-Name: None Aug 27 02:27:37.980202 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Identity-Status: Confirmed Aug 27 02:27:37.980202 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Is-Admin-Project: True Aug 27 02:27:37.980202 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Project-Domain-Id: default Aug 27 02:27:37.980202 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Project-Domain-Name: Default Aug 27 02:27:37.980202 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Project-Id: 8fba1fce5d474fecbb363f4175ef04ba Aug 27 02:27:37.980202 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1891697078 Aug 27 02:27:37.980202 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Role: member,reader Aug 27 02:27:37.980202 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Roles: member,reader Aug 27 02:27:37.982852 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/8fba1fce5d474fecbb363f4175ef04ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_8fba1fce5d474fecbb363f4175ef04ba", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8fba1fce5d474fecbb363f4175ef04ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8fba1fce5d474fecbb363f4175ef04ba"}]}] Aug 27 02:27:37.982852 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1891697078 Aug 27 02:27:37.982852 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Tenant-Id: 8fba1fce5d474fecbb363f4175ef04ba Aug 27 02:27:37.982852 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1891697078 Aug 27 02:27:37.982852 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User: tempest-VolumesSnapshotsTestJSON-1891697078-project Aug 27 02:27:37.982852 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User-Domain-Id: default Aug 27 02:27:37.982852 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User-Domain-Name: Default Aug 27 02:27:37.982852 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User-Id: d68b91da474448089739770f13901c13 Aug 27 02:27:37.982852 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1891697078-project Aug 27 02:27:37.982852 dv-cinder-846303-3-smb devstack@n-api.service[120783]: method: Aug 27 02:27:37.982852 dv-cinder-846303-3-smb devstack@n-api.service[120783]: exception: Volume 4447b692-ddd8-432f-90ac-f51662464309 could not be found. Aug 27 02:27:37.982852 dv-cinder-846303-3-smb devstack@n-api.service[120783]: action_args: {'id': '4447b692-ddd8-432f-90ac-f51662464309'} Aug 27 02:27:37.982852 dv-cinder-846303-3-smb devstack@n-api.service[120783]: {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:27:37.984886 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:37.984886 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 02:27:37.984886 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 02:27:37.984886 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 27 02:27:37.984886 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 27 02:27:37.984886 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 27 02:27:37.984886 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 27 02:27:37.984886 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 27 02:27:37.984886 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 27 02:27:37.984886 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 27 02:27:37.984886 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 27 02:27:37.984886 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 02:27:37.984886 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 02:27:37.984886 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 02:27:37.984886 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 02:27:37.984886 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4447b692-ddd8-432f-90ac-f51662464309 could not be found. (HTTP 404) (Request-ID: req-ee9c044a-ca4e-474f-a57c-491c8ecd1d15) Aug 27 02:27:37.984886 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:27:37.984886 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:27:37.984886 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:27:37.989094 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:37.989094 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 27 02:27:37.989094 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 27 02:27:37.989094 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 27 02:27:37.989094 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 27 02:27:37.989094 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 27 02:27:37.989094 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 27 02:27:37.989094 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 27 02:27:37.989094 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 27 02:27:37.989094 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 02:27:37.989094 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 02:27:37.989094 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 27 02:27:37.989094 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 27 02:27:37.989094 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 27 02:27:37.989094 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 27 02:27:37.989094 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 27 02:27:37.989094 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 27 02:27:37.989094 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 27 02:27:37.989094 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 27 02:27:37.992728 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 02:27:37.992728 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 02:27:37.992728 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 02:27:37.992728 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 02:27:37.992728 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4447b692-ddd8-432f-90ac-f51662464309 could not be found. Aug 27 02:27:37.992728 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:27:37.992728 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:27:37.992728 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:27:37.992728 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:37.992728 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:27:37.992728 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:27:37.992728 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:27:37.992728 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:27:37.992728 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:27:37.992728 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:27:37.992728 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:27:37.992728 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:27:37.992728 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 27 02:27:37.992728 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:27:37.994772 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4447b692-ddd8-432f-90ac-f51662464309 could not be found. Aug 27 02:27:37.994772 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:27:37.994772 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:27:37.994772 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:27:37.994772 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:37.994772 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:27:37.994772 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:27:37.994772 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:27:37.994772 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:27:37.994772 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4447b692-ddd8-432f-90ac-f51662464309 could not be found. Aug 27 02:27:37.994772 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:27:37.994772 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-7a68f445-1316-41ef-a3a6-0f18b03694c0 tempest-VolumesSnapshotsTestJSON-1891697078 tempest-VolumesSnapshotsTestJSON-1891697078-project] Returning 404 to user: Volume 4447b692-ddd8-432f-90ac-f51662464309 could not be found. {{(pid=120783) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:27:37.994772 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-7a68f445-1316-41ef-a3a6-0f18b03694c0 tempest-VolumesSnapshotsTestJSON-1891697078 tempest-VolumesSnapshotsTestJSON-1891697078-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/4447b692-ddd8-432f-90ac-f51662464309" status: 404 len: 109 microversion: 2.1 time: 0.041250 Aug 27 02:27:37.994772 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 493/1009] 10.222.0.61 () {58 vars in 1245 bytes} [Sat Aug 27 02:27:37 2022] GET /compute/v2.1/os-volumes/4447b692-ddd8-432f-90ac-f51662464309 => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:28:08.001893 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_api:SELECT=50,nova_api:DELETE=1 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:08.002650 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell1:SELECT=71 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:08.007704 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-8dd7f577-b970-482b-9372-faf5370f89c7 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:08.010020 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-8dd7f577-b970-482b-9372-faf5370f89c7 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 99f2f366-4776-427e-99cf-79399835f2c8] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:08.017894 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8dd7f577-b970-482b-9372-faf5370f89c7 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:08.018372 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8dd7f577-b970-482b-9372-faf5370f89c7 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:08.018804 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8dd7f577-b970-482b-9372-faf5370f89c7 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:08.019497 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8dd7f577-b970-482b-9372-faf5370f89c7 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:08.019944 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8dd7f577-b970-482b-9372-faf5370f89c7 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:08.020372 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8dd7f577-b970-482b-9372-faf5370f89c7 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:08.050434 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-8dd7f577-b970-482b-9372-faf5370f89c7 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.050288 Aug 27 02:28:08.051008 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 517/1010] 10.222.0.61 () {60 vars in 1343 bytes} [Sat Aug 27 02:28:07 2022] GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:28:08.113110 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Aug 27 02:28:08.113987 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_api:SELECT=37 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:08.114658 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell1:SELECT=30 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:08.120309 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-0ae22912-a0cd-4b6f-b010-7f2ae1609afe tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:08.121065 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-0ae22912-a0cd-4b6f-b010-7f2ae1609afe tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 99f2f366-4776-427e-99cf-79399835f2c8] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:08.129181 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0ae22912-a0cd-4b6f-b010-7f2ae1609afe tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:08.129696 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0ae22912-a0cd-4b6f-b010-7f2ae1609afe tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:08.130131 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0ae22912-a0cd-4b6f-b010-7f2ae1609afe tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:08.130828 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0ae22912-a0cd-4b6f-b010-7f2ae1609afe tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:08.131281 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0ae22912-a0cd-4b6f-b010-7f2ae1609afe tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:08.131703 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0ae22912-a0cd-4b6f-b010-7f2ae1609afe tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:08.158524 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-0ae22912-a0cd-4b6f-b010-7f2ae1609afe tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 99f2f366-4776-427e-99cf-79399835f2c8] Going to try to terminate instance {{(pid=120783) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:28:08.239369 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-0ae22912-a0cd-4b6f-b010-7f2ae1609afe tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "DELETE /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8" status: 204 len: 0 microversion: 2.20 time: 0.127720 Aug 27 02:28:08.239994 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 494/1011] 10.222.0.61 () {60 vars in 1280 bytes} [Sat Aug 27 02:28:08 2022] DELETE /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 02:28:08.248842 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-2a88efb5-a53e-43f2-9877-a2407b90caa1 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:08.249472 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-2a88efb5-a53e-43f2-9877-a2407b90caa1 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 99f2f366-4776-427e-99cf-79399835f2c8] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:08.255857 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2a88efb5-a53e-43f2-9877-a2407b90caa1 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:08.256323 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2a88efb5-a53e-43f2-9877-a2407b90caa1 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:08.256955 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2a88efb5-a53e-43f2-9877-a2407b90caa1 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:08.258289 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2a88efb5-a53e-43f2-9877-a2407b90caa1 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:08.258757 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2a88efb5-a53e-43f2-9877-a2407b90caa1 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:08.259239 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2a88efb5-a53e-43f2-9877-a2407b90caa1 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:08.401354 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-2a88efb5-a53e-43f2-9877-a2407b90caa1 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:08.409821 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-2a88efb5-a53e-43f2-9877-a2407b90caa1 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:08.411556 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-2a88efb5-a53e-43f2-9877-a2407b90caa1 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:08.412711 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-2a88efb5-a53e-43f2-9877-a2407b90caa1 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8" status: 200 len: 1722 microversion: 2.20 time: 0.167964 Aug 27 02:28:08.413279 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 518/1012] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:28:08 2022] GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:28:09.437365 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-16b624dd-85fe-4735-b17e-921ae864c470 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:09.437960 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-16b624dd-85fe-4735-b17e-921ae864c470 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 99f2f366-4776-427e-99cf-79399835f2c8] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:09.444727 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-16b624dd-85fe-4735-b17e-921ae864c470 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:09.445231 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-16b624dd-85fe-4735-b17e-921ae864c470 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:09.445681 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-16b624dd-85fe-4735-b17e-921ae864c470 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:09.446443 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-16b624dd-85fe-4735-b17e-921ae864c470 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:09.446887 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-16b624dd-85fe-4735-b17e-921ae864c470 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:09.447304 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-16b624dd-85fe-4735-b17e-921ae864c470 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:09.606099 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-16b624dd-85fe-4735-b17e-921ae864c470 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:09.614930 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-16b624dd-85fe-4735-b17e-921ae864c470 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:09.616425 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-16b624dd-85fe-4735-b17e-921ae864c470 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:09.617657 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-16b624dd-85fe-4735-b17e-921ae864c470 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8" status: 200 len: 1722 microversion: 2.20 time: 0.184859 Aug 27 02:28:09.618251 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 495/1013] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:28:09 2022] GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8 => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:28:10.641167 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-0a50e180-bd95-44de-9fe5-2dcd0ca71b34 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:10.642150 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-0a50e180-bd95-44de-9fe5-2dcd0ca71b34 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 99f2f366-4776-427e-99cf-79399835f2c8] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:10.649570 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0a50e180-bd95-44de-9fe5-2dcd0ca71b34 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:10.649839 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0a50e180-bd95-44de-9fe5-2dcd0ca71b34 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:10.650271 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0a50e180-bd95-44de-9fe5-2dcd0ca71b34 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:10.651025 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0a50e180-bd95-44de-9fe5-2dcd0ca71b34 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:10.651458 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0a50e180-bd95-44de-9fe5-2dcd0ca71b34 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:10.651877 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0a50e180-bd95-44de-9fe5-2dcd0ca71b34 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:10.753161 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-0a50e180-bd95-44de-9fe5-2dcd0ca71b34 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:10.764750 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-0a50e180-bd95-44de-9fe5-2dcd0ca71b34 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:10.766233 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-0a50e180-bd95-44de-9fe5-2dcd0ca71b34 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd08f3b52004476b9eb532c7c68ab679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9409824440cb45508754064b55438edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:10.767952 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-0a50e180-bd95-44de-9fe5-2dcd0ca71b34 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8" status: 200 len: 1654 microversion: 2.20 time: 0.131388 Aug 27 02:28:10.769258 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 519/1014] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:28:10 2022] GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8 => generated 1654 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:28:10.789184 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [req-6fdcbc9c-22d2-4364-b2e0-d8aefbcced51 req-655e0522-6d8a-41de-b87b-c96910f9dd26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99f2f366-4776-427e-99cf-79399835f2c8", "name": "network-vif-deleted", "tag": "dc94d858-1637-4028-b898-2687b284cae7"}]} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:28:10.812304 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-6fdcbc9c-22d2-4364-b2e0-d8aefbcced51 req-655e0522-6d8a-41de-b87b-c96910f9dd26 service nova] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:10.812895 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-6fdcbc9c-22d2-4364-b2e0-d8aefbcced51 req-655e0522-6d8a-41de-b87b-c96910f9dd26 service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:10.813523 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-6fdcbc9c-22d2-4364-b2e0-d8aefbcced51 req-655e0522-6d8a-41de-b87b-c96910f9dd26 service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:10.830824 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.compute.server_external_events [req-6fdcbc9c-22d2-4364-b2e0-d8aefbcced51 req-655e0522-6d8a-41de-b87b-c96910f9dd26 service nova] Creating event network-vif-deleted:dc94d858-1637-4028-b898-2687b284cae7 for instance 99f2f366-4776-427e-99cf-79399835f2c8 on hv-cinder-84630 Aug 27 02:28:10.842006 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [req-6fdcbc9c-22d2-4364-b2e0-d8aefbcced51 req-655e0522-6d8a-41de-b87b-c96910f9dd26 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051692 Aug 27 02:28:10.842709 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 496/1015] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Aug 27 02:28:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:28:11.791266 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-21bc69b9-04dc-44c5-b94d-db314a07d204 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:11.791861 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-21bc69b9-04dc-44c5-b94d-db314a07d204 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 99f2f366-4776-427e-99cf-79399835f2c8] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:11.800319 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-21bc69b9-04dc-44c5-b94d-db314a07d204 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:11.800817 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-21bc69b9-04dc-44c5-b94d-db314a07d204 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:11.801244 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-21bc69b9-04dc-44c5-b94d-db314a07d204 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:11.801980 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-21bc69b9-04dc-44c5-b94d-db314a07d204 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:11.802409 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-21bc69b9-04dc-44c5-b94d-db314a07d204 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:11.802822 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-21bc69b9-04dc-44c5-b94d-db314a07d204 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:11.826463 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.wsgi [None req-21bc69b9-04dc-44c5-b94d-db314a07d204 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] HTTP exception thrown: Instance 99f2f366-4776-427e-99cf-79399835f2c8 could not be found. Aug 27 02:28:11.829514 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-21bc69b9-04dc-44c5-b94d-db314a07d204 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Request method failure captured: Aug 27 02:28:11.829514 dv-cinder-846303-3-smb devstack@n-api.service[120782]: request: GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8 HTTP/1.1 Aug 27 02:28:11.829514 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Accept: application/json Aug 27 02:28:11.829514 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Accept-Encoding: identity Aug 27 02:28:11.829514 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Connection: close Aug 27 02:28:11.829514 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Content-Length: 0 Aug 27 02:28:11.829514 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Content-Type: application/json Aug 27 02:28:11.829514 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Host: 10.222.0.61 Aug 27 02:28:11.829514 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Openstack-System-Scope: None Aug 27 02:28:11.829514 dv-cinder-846303-3-smb devstack@n-api.service[120782]: User-Agent: python-urllib3/1.26.11 Aug 27 02:28:11.829514 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Auth-Token: gAAAAABjCX-NL7PN5YuGlTifkm6bkq5aj7zAK0PJaEtfqY4JdnQh7Dc-iLBs9yrPb9ysb0HzdvfbIKz7tBDsbd8gK3YV60jxlF-7Ydr56BDh45Q4CiEorXN3T2CkeEqdbY4S1RhTmJIn1Z4W5beCdfRqyig--AFk-QiM6HrjaSEjIstgLTxSx4Q Aug 27 02:28:11.829514 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Domain-Id: None Aug 27 02:28:11.829514 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Domain-Name: None Aug 27 02:28:11.829514 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Identity-Status: Confirmed Aug 27 02:28:11.829514 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Is-Admin-Project: True Aug 27 02:28:11.829514 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Openstack-Nova-Api-Version: 2.20 Aug 27 02:28:11.829514 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Domain-Id: default Aug 27 02:28:11.829514 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Domain-Name: Default Aug 27 02:28:11.829514 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Id: 9409824440cb45508754064b55438edd Aug 27 02:28:11.829514 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-832533989 Aug 27 02:28:11.829514 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Role: member,reader Aug 27 02:28:11.829514 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Roles: member,reader Aug 27 02:28:11.831012 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9409824440cb45508754064b55438edd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9409824440cb45508754064b55438edd", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9409824440cb45508754064b55438edd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9409824440cb45508754064b55438edd"}]}] Aug 27 02:28:11.831012 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Tenant: tempest-AttachVolumeShelveTestJSON-832533989 Aug 27 02:28:11.831012 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Tenant-Id: 9409824440cb45508754064b55438edd Aug 27 02:28:11.831012 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-832533989 Aug 27 02:28:11.831012 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User: tempest-AttachVolumeShelveTestJSON-832533989-project Aug 27 02:28:11.831012 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Domain-Id: default Aug 27 02:28:11.831012 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Domain-Name: Default Aug 27 02:28:11.831012 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Id: cd08f3b52004476b9eb532c7c68ab679 Aug 27 02:28:11.831012 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Name: tempest-AttachVolumeShelveTestJSON-832533989-project Aug 27 02:28:11.831012 dv-cinder-846303-3-smb devstack@n-api.service[120782]: method: > Aug 27 02:28:11.831012 dv-cinder-846303-3-smb devstack@n-api.service[120782]: exception: Instance 99f2f366-4776-427e-99cf-79399835f2c8 could not be found. Aug 27 02:28:11.831012 dv-cinder-846303-3-smb devstack@n-api.service[120782]: action_args: {'id': '99f2f366-4776-427e-99cf-79399835f2c8'} Aug 27 02:28:11.831814 dv-cinder-846303-3-smb devstack@n-api.service[120782]: {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:28:11.831814 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:11.831814 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:28:11.831814 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:28:11.831814 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:28:11.831814 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:28:11.831814 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:28:11.831814 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:28:11.831814 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:28:11.831814 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:28:11.831814 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99f2f366-4776-427e-99cf-79399835f2c8 could not be found. Aug 27 02:28:11.831814 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:28:11.831814 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:28:11.831814 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:28:11.831814 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:11.831814 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:11.831814 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:11.831814 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:28:11.831814 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:28:11.831814 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:28:11.833727 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:28:11.833727 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:28:11.833727 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:28:11.833727 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:28:11.833727 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:28:11.833727 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:28:11.833727 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:28:11.833727 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99f2f366-4776-427e-99cf-79399835f2c8 could not be found. Aug 27 02:28:11.833727 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:28:11.833727 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:28:11.833727 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:28:11.833727 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:11.833727 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:11.833727 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:11.833727 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:28:11.833727 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:28:11.833727 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99f2f366-4776-427e-99cf-79399835f2c8 could not be found. Aug 27 02:28:11.833727 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:28:11.835338 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-21bc69b9-04dc-44c5-b94d-db314a07d204 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Returning 404 to user: Instance 99f2f366-4776-427e-99cf-79399835f2c8 could not be found. {{(pid=120782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:28:11.835338 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-21bc69b9-04dc-44c5-b94d-db314a07d204 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8" status: 404 len: 111 microversion: 2.20 time: 0.045088 Aug 27 02:28:11.835338 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 520/1016] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:28:11 2022] GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:28:11.842056 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-de2ab6d0-8f91-43a2-9933-12e77e086647 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '.version_select at 0x7fd808527670>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:11.868011 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-de2ab6d0-8f91-43a2-9933-12e77e086647 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-998764215" status: 204 len: 0 microversion: 2.20 time: 0.030064 Aug 27 02:28:11.872296 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 497/1017] 10.222.0.61 () {60 vars in 1259 bytes} [Sat Aug 27 02:28:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-998764215 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 02:28:13.764854 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-1e01a1af-5ec6-43b4-8907-72e5364f254d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:13.765440 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-1e01a1af-5ec6-43b4-8907-72e5364f254d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 99f2f366-4776-427e-99cf-79399835f2c8] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:13.772557 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1e01a1af-5ec6-43b4-8907-72e5364f254d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:13.773033 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1e01a1af-5ec6-43b4-8907-72e5364f254d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:13.773494 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1e01a1af-5ec6-43b4-8907-72e5364f254d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:13.774186 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1e01a1af-5ec6-43b4-8907-72e5364f254d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:13.774624 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1e01a1af-5ec6-43b4-8907-72e5364f254d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:13.775057 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1e01a1af-5ec6-43b4-8907-72e5364f254d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:13.788996 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.wsgi [None req-1e01a1af-5ec6-43b4-8907-72e5364f254d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] HTTP exception thrown: Instance 99f2f366-4776-427e-99cf-79399835f2c8 could not be found. Aug 27 02:28:13.790603 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-1e01a1af-5ec6-43b4-8907-72e5364f254d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Request method failure captured: Aug 27 02:28:13.790603 dv-cinder-846303-3-smb devstack@n-api.service[120782]: request: DELETE /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8 HTTP/1.1 Aug 27 02:28:13.790603 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Accept: application/json Aug 27 02:28:13.790603 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Accept-Encoding: identity Aug 27 02:28:13.790603 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Connection: close Aug 27 02:28:13.790603 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Content-Length: 0 Aug 27 02:28:13.790603 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Content-Type: application/json Aug 27 02:28:13.790603 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Host: 10.222.0.61 Aug 27 02:28:13.790603 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Openstack-System-Scope: None Aug 27 02:28:13.790603 dv-cinder-846303-3-smb devstack@n-api.service[120782]: User-Agent: python-urllib3/1.26.11 Aug 27 02:28:13.790603 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Auth-Token: gAAAAABjCX-NL7PN5YuGlTifkm6bkq5aj7zAK0PJaEtfqY4JdnQh7Dc-iLBs9yrPb9ysb0HzdvfbIKz7tBDsbd8gK3YV60jxlF-7Ydr56BDh45Q4CiEorXN3T2CkeEqdbY4S1RhTmJIn1Z4W5beCdfRqyig--AFk-QiM6HrjaSEjIstgLTxSx4Q Aug 27 02:28:13.790603 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Domain-Id: None Aug 27 02:28:13.790603 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Domain-Name: None Aug 27 02:28:13.790603 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Identity-Status: Confirmed Aug 27 02:28:13.790603 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Is-Admin-Project: True Aug 27 02:28:13.790603 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Openstack-Nova-Api-Version: 2.20 Aug 27 02:28:13.790603 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Domain-Id: default Aug 27 02:28:13.790603 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Domain-Name: Default Aug 27 02:28:13.790603 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Id: 9409824440cb45508754064b55438edd Aug 27 02:28:13.790603 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-832533989 Aug 27 02:28:13.790603 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Role: member,reader Aug 27 02:28:13.790603 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Roles: member,reader Aug 27 02:28:13.792486 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9409824440cb45508754064b55438edd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9409824440cb45508754064b55438edd", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9409824440cb45508754064b55438edd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9409824440cb45508754064b55438edd"}]}] Aug 27 02:28:13.792486 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Tenant: tempest-AttachVolumeShelveTestJSON-832533989 Aug 27 02:28:13.792486 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Tenant-Id: 9409824440cb45508754064b55438edd Aug 27 02:28:13.792486 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-832533989 Aug 27 02:28:13.792486 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User: tempest-AttachVolumeShelveTestJSON-832533989-project Aug 27 02:28:13.792486 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Domain-Id: default Aug 27 02:28:13.792486 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Domain-Name: Default Aug 27 02:28:13.792486 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Id: cd08f3b52004476b9eb532c7c68ab679 Aug 27 02:28:13.792486 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Name: tempest-AttachVolumeShelveTestJSON-832533989-project Aug 27 02:28:13.792486 dv-cinder-846303-3-smb devstack@n-api.service[120782]: method: > Aug 27 02:28:13.792486 dv-cinder-846303-3-smb devstack@n-api.service[120782]: exception: Instance 99f2f366-4776-427e-99cf-79399835f2c8 could not be found. Aug 27 02:28:13.792486 dv-cinder-846303-3-smb devstack@n-api.service[120782]: action_args: {'id': '99f2f366-4776-427e-99cf-79399835f2c8'} Aug 27 02:28:13.793554 dv-cinder-846303-3-smb devstack@n-api.service[120782]: {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:28:13.793554 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:13.793554 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:28:13.793554 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:28:13.793554 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:28:13.793554 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:28:13.793554 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:28:13.793554 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:28:13.793554 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:28:13.793554 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:28:13.793554 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99f2f366-4776-427e-99cf-79399835f2c8 could not be found. Aug 27 02:28:13.793554 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:28:13.793554 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:28:13.793554 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:28:13.793554 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:13.793554 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:13.793554 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:13.793554 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:28:13.793554 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:28:13.793554 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:28:13.794913 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:28:13.794913 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 02:28:13.794913 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 02:28:13.794913 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 02:28:13.794913 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 02:28:13.794913 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:28:13.794913 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:28:13.794913 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:28:13.794913 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:28:13.794913 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99f2f366-4776-427e-99cf-79399835f2c8 could not be found. Aug 27 02:28:13.794913 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:28:13.794913 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:28:13.794913 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:28:13.794913 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:13.794913 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:13.794913 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:13.794913 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:28:13.794913 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:28:13.794913 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99f2f366-4776-427e-99cf-79399835f2c8 could not be found. Aug 27 02:28:13.794913 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:28:13.796753 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-1e01a1af-5ec6-43b4-8907-72e5364f254d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Returning 404 to user: Instance 99f2f366-4776-427e-99cf-79399835f2c8 could not be found. {{(pid=120782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:28:13.796753 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-1e01a1af-5ec6-43b4-8907-72e5364f254d tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "DELETE /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8" status: 404 len: 111 microversion: 2.20 time: 0.032655 Aug 27 02:28:13.796753 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 521/1018] 10.222.0.61 () {60 vars in 1280 bytes} [Sat Aug 27 02:28:13 2022] DELETE /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:28:13.801861 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-854d15ae-826f-4b63-8cc5-e759c41baa43 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:13.802729 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-854d15ae-826f-4b63-8cc5-e759c41baa43 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 99f2f366-4776-427e-99cf-79399835f2c8] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:13.809917 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-854d15ae-826f-4b63-8cc5-e759c41baa43 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:13.810495 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-854d15ae-826f-4b63-8cc5-e759c41baa43 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:13.810921 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-854d15ae-826f-4b63-8cc5-e759c41baa43 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:13.811613 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-854d15ae-826f-4b63-8cc5-e759c41baa43 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:13.812057 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-854d15ae-826f-4b63-8cc5-e759c41baa43 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:13.812472 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-854d15ae-826f-4b63-8cc5-e759c41baa43 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:13.831576 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.wsgi [None req-854d15ae-826f-4b63-8cc5-e759c41baa43 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] HTTP exception thrown: Instance 99f2f366-4776-427e-99cf-79399835f2c8 could not be found. Aug 27 02:28:13.831576 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-854d15ae-826f-4b63-8cc5-e759c41baa43 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Request method failure captured: Aug 27 02:28:13.831576 dv-cinder-846303-3-smb devstack@n-api.service[120783]: request: GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8 HTTP/1.1 Aug 27 02:28:13.831576 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Accept: application/json Aug 27 02:28:13.831576 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Accept-Encoding: identity Aug 27 02:28:13.831576 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Connection: close Aug 27 02:28:13.831576 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Content-Length: 0 Aug 27 02:28:13.831576 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Content-Type: application/json Aug 27 02:28:13.831576 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Host: 10.222.0.61 Aug 27 02:28:13.831576 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Openstack-System-Scope: None Aug 27 02:28:13.831576 dv-cinder-846303-3-smb devstack@n-api.service[120783]: User-Agent: python-urllib3/1.26.11 Aug 27 02:28:13.831576 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Auth-Token: gAAAAABjCX-NL7PN5YuGlTifkm6bkq5aj7zAK0PJaEtfqY4JdnQh7Dc-iLBs9yrPb9ysb0HzdvfbIKz7tBDsbd8gK3YV60jxlF-7Ydr56BDh45Q4CiEorXN3T2CkeEqdbY4S1RhTmJIn1Z4W5beCdfRqyig--AFk-QiM6HrjaSEjIstgLTxSx4Q Aug 27 02:28:13.831576 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Domain-Id: None Aug 27 02:28:13.831576 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Domain-Name: None Aug 27 02:28:13.831576 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Identity-Status: Confirmed Aug 27 02:28:13.831576 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Is-Admin-Project: True Aug 27 02:28:13.831576 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Openstack-Nova-Api-Version: 2.20 Aug 27 02:28:13.831576 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Project-Domain-Id: default Aug 27 02:28:13.831576 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Project-Domain-Name: Default Aug 27 02:28:13.831576 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Project-Id: 9409824440cb45508754064b55438edd Aug 27 02:28:13.831576 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-832533989 Aug 27 02:28:13.831576 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Role: member,reader Aug 27 02:28:13.831576 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Roles: member,reader Aug 27 02:28:13.835522 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9409824440cb45508754064b55438edd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9409824440cb45508754064b55438edd", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9409824440cb45508754064b55438edd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9409824440cb45508754064b55438edd"}]}] Aug 27 02:28:13.835522 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Tenant: tempest-AttachVolumeShelveTestJSON-832533989 Aug 27 02:28:13.835522 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Tenant-Id: 9409824440cb45508754064b55438edd Aug 27 02:28:13.835522 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-832533989 Aug 27 02:28:13.835522 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User: tempest-AttachVolumeShelveTestJSON-832533989-project Aug 27 02:28:13.835522 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User-Domain-Id: default Aug 27 02:28:13.835522 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User-Domain-Name: Default Aug 27 02:28:13.835522 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User-Id: cd08f3b52004476b9eb532c7c68ab679 Aug 27 02:28:13.835522 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User-Name: tempest-AttachVolumeShelveTestJSON-832533989-project Aug 27 02:28:13.835522 dv-cinder-846303-3-smb devstack@n-api.service[120783]: method: > Aug 27 02:28:13.835522 dv-cinder-846303-3-smb devstack@n-api.service[120783]: exception: Instance 99f2f366-4776-427e-99cf-79399835f2c8 could not be found. Aug 27 02:28:13.835522 dv-cinder-846303-3-smb devstack@n-api.service[120783]: action_args: {'id': '99f2f366-4776-427e-99cf-79399835f2c8'} Aug 27 02:28:13.836436 dv-cinder-846303-3-smb devstack@n-api.service[120783]: {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:28:13.836436 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:13.836436 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:28:13.836436 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:28:13.836436 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:28:13.836436 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:28:13.836436 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:28:13.836436 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:28:13.836436 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:28:13.836436 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:28:13.836436 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99f2f366-4776-427e-99cf-79399835f2c8 could not be found. Aug 27 02:28:13.836436 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:28:13.836436 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:28:13.836436 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:28:13.836436 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:13.836436 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:13.836436 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:13.836436 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:28:13.836436 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:28:13.836436 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:28:13.838031 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:28:13.838031 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:28:13.838031 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:28:13.838031 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:28:13.838031 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:28:13.838031 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:28:13.838031 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:28:13.838031 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99f2f366-4776-427e-99cf-79399835f2c8 could not be found. Aug 27 02:28:13.838031 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:28:13.838031 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:28:13.838031 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:28:13.838031 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:13.838031 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:13.838031 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:13.838031 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:28:13.838031 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:28:13.838031 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99f2f366-4776-427e-99cf-79399835f2c8 could not be found. Aug 27 02:28:13.838031 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:28:13.839658 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-854d15ae-826f-4b63-8cc5-e759c41baa43 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Returning 404 to user: Instance 99f2f366-4776-427e-99cf-79399835f2c8 could not be found. {{(pid=120783) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:28:13.839658 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-854d15ae-826f-4b63-8cc5-e759c41baa43 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8" status: 404 len: 111 microversion: 2.20 time: 0.034144 Aug 27 02:28:13.839658 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 498/1019] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:28:13 2022] GET /compute/v2.1/servers/99f2f366-4776-427e-99cf-79399835f2c8 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:28:14.990854 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-736bb50b-cba3-48cd-afc0-aac40cc7b6bb tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:14.991349 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-736bb50b-cba3-48cd-afc0-aac40cc7b6bb tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:14.998521 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-736bb50b-cba3-48cd-afc0-aac40cc7b6bb tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:14.999013 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-736bb50b-cba3-48cd-afc0-aac40cc7b6bb tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:14.999438 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-736bb50b-cba3-48cd-afc0-aac40cc7b6bb tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:15.000140 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-736bb50b-cba3-48cd-afc0-aac40cc7b6bb tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:15.000784 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-736bb50b-cba3-48cd-afc0-aac40cc7b6bb tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:15.001287 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-736bb50b-cba3-48cd-afc0-aac40cc7b6bb tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:15.018376 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.wsgi [None req-736bb50b-cba3-48cd-afc0-aac40cc7b6bb tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] HTTP exception thrown: Instance 47d706cc-4f9b-4d59-8eca-caae165ec5db could not be found. Aug 27 02:28:15.020494 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-736bb50b-cba3-48cd-afc0-aac40cc7b6bb tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Request method failure captured: Aug 27 02:28:15.020494 dv-cinder-846303-3-smb devstack@n-api.service[120782]: request: DELETE /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db HTTP/1.1 Aug 27 02:28:15.020494 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Accept: application/json Aug 27 02:28:15.020494 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Accept-Encoding: identity Aug 27 02:28:15.020494 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Connection: close Aug 27 02:28:15.020494 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Content-Length: 0 Aug 27 02:28:15.020494 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Content-Type: application/json Aug 27 02:28:15.020494 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Host: 10.222.0.61 Aug 27 02:28:15.020494 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Openstack-System-Scope: None Aug 27 02:28:15.020494 dv-cinder-846303-3-smb devstack@n-api.service[120782]: User-Agent: python-urllib3/1.26.11 Aug 27 02:28:15.020494 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Auth-Token: gAAAAABjCX-NL7PN5YuGlTifkm6bkq5aj7zAK0PJaEtfqY4JdnQh7Dc-iLBs9yrPb9ysb0HzdvfbIKz7tBDsbd8gK3YV60jxlF-7Ydr56BDh45Q4CiEorXN3T2CkeEqdbY4S1RhTmJIn1Z4W5beCdfRqyig--AFk-QiM6HrjaSEjIstgLTxSx4Q Aug 27 02:28:15.020494 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Domain-Id: None Aug 27 02:28:15.020494 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Domain-Name: None Aug 27 02:28:15.020494 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Identity-Status: Confirmed Aug 27 02:28:15.020494 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Is-Admin-Project: True Aug 27 02:28:15.020494 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Openstack-Nova-Api-Version: 2.20 Aug 27 02:28:15.020494 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Domain-Id: default Aug 27 02:28:15.020494 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Domain-Name: Default Aug 27 02:28:15.020494 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Id: 9409824440cb45508754064b55438edd Aug 27 02:28:15.020494 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-832533989 Aug 27 02:28:15.020494 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Role: member,reader Aug 27 02:28:15.020494 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Roles: member,reader Aug 27 02:28:15.022164 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9409824440cb45508754064b55438edd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9409824440cb45508754064b55438edd", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9409824440cb45508754064b55438edd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9409824440cb45508754064b55438edd"}]}] Aug 27 02:28:15.022164 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Tenant: tempest-AttachVolumeShelveTestJSON-832533989 Aug 27 02:28:15.022164 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Tenant-Id: 9409824440cb45508754064b55438edd Aug 27 02:28:15.022164 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-832533989 Aug 27 02:28:15.022164 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User: tempest-AttachVolumeShelveTestJSON-832533989-project Aug 27 02:28:15.022164 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Domain-Id: default Aug 27 02:28:15.022164 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Domain-Name: Default Aug 27 02:28:15.022164 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Id: cd08f3b52004476b9eb532c7c68ab679 Aug 27 02:28:15.022164 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Name: tempest-AttachVolumeShelveTestJSON-832533989-project Aug 27 02:28:15.022164 dv-cinder-846303-3-smb devstack@n-api.service[120782]: method: > Aug 27 02:28:15.022164 dv-cinder-846303-3-smb devstack@n-api.service[120782]: exception: Instance 47d706cc-4f9b-4d59-8eca-caae165ec5db could not be found. Aug 27 02:28:15.022164 dv-cinder-846303-3-smb devstack@n-api.service[120782]: action_args: {'id': '47d706cc-4f9b-4d59-8eca-caae165ec5db'} Aug 27 02:28:15.023017 dv-cinder-846303-3-smb devstack@n-api.service[120782]: {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:28:15.023017 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:15.023017 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:28:15.023017 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:28:15.023017 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:28:15.023017 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:28:15.023017 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:28:15.023017 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:28:15.023017 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:28:15.023017 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:28:15.023017 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47d706cc-4f9b-4d59-8eca-caae165ec5db could not be found. Aug 27 02:28:15.023017 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:28:15.023017 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:28:15.023017 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:28:15.023017 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:15.023017 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:15.023017 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:15.023017 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:28:15.023017 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:28:15.023017 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:28:15.024641 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:28:15.024641 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 02:28:15.024641 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 02:28:15.024641 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 02:28:15.024641 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 02:28:15.024641 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:28:15.024641 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:28:15.024641 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:28:15.024641 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:28:15.024641 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47d706cc-4f9b-4d59-8eca-caae165ec5db could not be found. Aug 27 02:28:15.024641 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:28:15.024641 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:28:15.024641 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:28:15.024641 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:15.024641 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:15.024641 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:15.024641 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:28:15.024641 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:28:15.024641 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47d706cc-4f9b-4d59-8eca-caae165ec5db could not be found. Aug 27 02:28:15.024641 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:28:15.026494 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-736bb50b-cba3-48cd-afc0-aac40cc7b6bb tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Returning 404 to user: Instance 47d706cc-4f9b-4d59-8eca-caae165ec5db could not be found. {{(pid=120782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:28:15.026494 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-736bb50b-cba3-48cd-afc0-aac40cc7b6bb tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "DELETE /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db" status: 404 len: 111 microversion: 2.20 time: 0.035839 Aug 27 02:28:15.026494 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 522/1020] 10.222.0.61 () {60 vars in 1280 bytes} [Sat Aug 27 02:28:14 2022] DELETE /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:28:15.031706 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-8963d757-af68-4e89-8cc0-75d92e2f69b1 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:15.032357 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-8963d757-af68-4e89-8cc0-75d92e2f69b1 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] [instance: 47d706cc-4f9b-4d59-8eca-caae165ec5db] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:15.039373 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8963d757-af68-4e89-8cc0-75d92e2f69b1 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:15.040063 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8963d757-af68-4e89-8cc0-75d92e2f69b1 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:15.040792 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8963d757-af68-4e89-8cc0-75d92e2f69b1 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:15.042209 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8963d757-af68-4e89-8cc0-75d92e2f69b1 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:15.042941 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8963d757-af68-4e89-8cc0-75d92e2f69b1 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:15.043716 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8963d757-af68-4e89-8cc0-75d92e2f69b1 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:15.069609 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.wsgi [None req-8963d757-af68-4e89-8cc0-75d92e2f69b1 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] HTTP exception thrown: Instance 47d706cc-4f9b-4d59-8eca-caae165ec5db could not be found. Aug 27 02:28:15.071159 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-8963d757-af68-4e89-8cc0-75d92e2f69b1 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Request method failure captured: Aug 27 02:28:15.071159 dv-cinder-846303-3-smb devstack@n-api.service[120783]: request: GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db HTTP/1.1 Aug 27 02:28:15.071159 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Accept: application/json Aug 27 02:28:15.071159 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Accept-Encoding: identity Aug 27 02:28:15.071159 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Connection: close Aug 27 02:28:15.071159 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Content-Length: 0 Aug 27 02:28:15.071159 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Content-Type: application/json Aug 27 02:28:15.071159 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Host: 10.222.0.61 Aug 27 02:28:15.071159 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Openstack-System-Scope: None Aug 27 02:28:15.071159 dv-cinder-846303-3-smb devstack@n-api.service[120783]: User-Agent: python-urllib3/1.26.11 Aug 27 02:28:15.071159 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Auth-Token: gAAAAABjCX-NL7PN5YuGlTifkm6bkq5aj7zAK0PJaEtfqY4JdnQh7Dc-iLBs9yrPb9ysb0HzdvfbIKz7tBDsbd8gK3YV60jxlF-7Ydr56BDh45Q4CiEorXN3T2CkeEqdbY4S1RhTmJIn1Z4W5beCdfRqyig--AFk-QiM6HrjaSEjIstgLTxSx4Q Aug 27 02:28:15.071159 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Domain-Id: None Aug 27 02:28:15.071159 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Domain-Name: None Aug 27 02:28:15.071159 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Identity-Status: Confirmed Aug 27 02:28:15.071159 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Is-Admin-Project: True Aug 27 02:28:15.071159 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Openstack-Nova-Api-Version: 2.20 Aug 27 02:28:15.071159 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Project-Domain-Id: default Aug 27 02:28:15.071159 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Project-Domain-Name: Default Aug 27 02:28:15.071159 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Project-Id: 9409824440cb45508754064b55438edd Aug 27 02:28:15.071159 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-832533989 Aug 27 02:28:15.071159 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Role: member,reader Aug 27 02:28:15.071159 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Roles: member,reader Aug 27 02:28:15.072759 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9409824440cb45508754064b55438edd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9409824440cb45508754064b55438edd", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9409824440cb45508754064b55438edd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9409824440cb45508754064b55438edd"}]}] Aug 27 02:28:15.072759 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Tenant: tempest-AttachVolumeShelveTestJSON-832533989 Aug 27 02:28:15.072759 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Tenant-Id: 9409824440cb45508754064b55438edd Aug 27 02:28:15.072759 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-832533989 Aug 27 02:28:15.072759 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User: tempest-AttachVolumeShelveTestJSON-832533989-project Aug 27 02:28:15.072759 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User-Domain-Id: default Aug 27 02:28:15.072759 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User-Domain-Name: Default Aug 27 02:28:15.072759 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User-Id: cd08f3b52004476b9eb532c7c68ab679 Aug 27 02:28:15.072759 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User-Name: tempest-AttachVolumeShelveTestJSON-832533989-project Aug 27 02:28:15.072759 dv-cinder-846303-3-smb devstack@n-api.service[120783]: method: > Aug 27 02:28:15.072759 dv-cinder-846303-3-smb devstack@n-api.service[120783]: exception: Instance 47d706cc-4f9b-4d59-8eca-caae165ec5db could not be found. Aug 27 02:28:15.072759 dv-cinder-846303-3-smb devstack@n-api.service[120783]: action_args: {'id': '47d706cc-4f9b-4d59-8eca-caae165ec5db'} Aug 27 02:28:15.073802 dv-cinder-846303-3-smb devstack@n-api.service[120783]: {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:28:15.073802 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:15.073802 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:28:15.073802 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:28:15.073802 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:28:15.073802 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:28:15.073802 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:28:15.073802 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:28:15.073802 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:28:15.073802 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:28:15.073802 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47d706cc-4f9b-4d59-8eca-caae165ec5db could not be found. Aug 27 02:28:15.073802 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:28:15.073802 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:28:15.073802 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:28:15.073802 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:15.073802 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:15.073802 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:15.073802 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:28:15.073802 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:28:15.073802 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:28:15.075136 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:28:15.075136 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:28:15.075136 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:28:15.075136 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:28:15.075136 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:28:15.075136 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:28:15.075136 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:28:15.075136 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47d706cc-4f9b-4d59-8eca-caae165ec5db could not be found. Aug 27 02:28:15.075136 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:28:15.075136 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:28:15.075136 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:28:15.075136 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:15.075136 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:15.075136 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:15.075136 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:28:15.075136 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:28:15.075136 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47d706cc-4f9b-4d59-8eca-caae165ec5db could not be found. Aug 27 02:28:15.075136 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:28:15.076253 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-8963d757-af68-4e89-8cc0-75d92e2f69b1 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] Returning 404 to user: Instance 47d706cc-4f9b-4d59-8eca-caae165ec5db could not be found. {{(pid=120783) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:28:15.076253 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-8963d757-af68-4e89-8cc0-75d92e2f69b1 tempest-AttachVolumeShelveTestJSON-832533989 tempest-AttachVolumeShelveTestJSON-832533989-project] 10.222.0.61 "GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db" status: 404 len: 111 microversion: 2.20 time: 0.044935 Aug 27 02:28:15.076253 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 499/1021] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Aug 27 02:28:15 2022] GET /compute/v2.1/servers/47d706cc-4f9b-4d59-8eca-caae165ec5db => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:28:45.845835 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-01f2075f-8c84-48cb-8952-9c03fc7c079b tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1838228141", "imageRef": "7d45cdd6-750f-40c7-9475-f7bf12fcb204", "flavorRef": "452", "networks": [{"uuid": "bb27b2c3-6005-4f6b-968f-fdc7e91bdeda"}]}} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:28:45.855216 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_api:SELECT=12 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:45.856348 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell1:SELECT=24 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:45.912884 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.network.neutron [None req-01f2075f-8c84-48cb-8952-9c03fc7c079b tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] validate_networks() for [('bb27b2c3-6005-4f6b-968f-fdc7e91bdeda', None, None, None, None, None)] {{(pid=120782) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:28:46.490713 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-bd10ceec-d3c6-4b1a-b169-d638c1d54e2d tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:46.491923 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-bd10ceec-d3c6-4b1a-b169-d638c1d54e2d tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] [instance: 9fb59350-4f09-4e20-bddb-ffc9a65897b3] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:46.494666 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:46.495885 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:46.502356 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bd10ceec-d3c6-4b1a-b169-d638c1d54e2d tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:46.502981 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bd10ceec-d3c6-4b1a-b169-d638c1d54e2d tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:46.503682 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bd10ceec-d3c6-4b1a-b169-d638c1d54e2d tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:46.504628 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bd10ceec-d3c6-4b1a-b169-d638c1d54e2d tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:46.505319 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bd10ceec-d3c6-4b1a-b169-d638c1d54e2d tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:46.506130 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bd10ceec-d3c6-4b1a-b169-d638c1d54e2d tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:46.538697 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-bd10ceec-d3c6-4b1a-b169-d638c1d54e2d tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] [instance: 9fb59350-4f09-4e20-bddb-ffc9a65897b3] Going to try to terminate instance {{(pid=120783) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:28:46.649664 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-bd10ceec-d3c6-4b1a-b169-d638c1d54e2d tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] 10.222.0.61 "DELETE /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3" status: 204 len: 0 microversion: 2.1 time: 0.161110 Aug 27 02:28:46.650301 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 500/1022] 10.222.0.61 () {58 vars in 1239 bytes} [Sat Aug 27 02:28:46 2022] DELETE /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:28:46.657333 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [req-5a2c69fb-06f0-49c8-a8db-88f92ff87dcf req-f42ea48a-3462-4ff9-a33b-a72e2657e599 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fb59350-4f09-4e20-bddb-ffc9a65897b3", "tag": "b6386749-9042-42f7-933e-fe24b60012ef"}]} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:28:46.669389 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-5a2c69fb-06f0-49c8-a8db-88f92ff87dcf req-f42ea48a-3462-4ff9-a33b-a72e2657e599 service nova] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:46.670378 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-5a2c69fb-06f0-49c8-a8db-88f92ff87dcf req-f42ea48a-3462-4ff9-a33b-a72e2657e599 service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:46.671013 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-5a2c69fb-06f0-49c8-a8db-88f92ff87dcf req-f42ea48a-3462-4ff9-a33b-a72e2657e599 service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:46.671807 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-01f2075f-8c84-48cb-8952-9c03fc7c079b tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Flavor limits 0:0:0 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:28:46.672781 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-01f2075f-8c84-48cb-8952-9c03fc7c079b tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Image limits 0:0:0 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:28:46.673450 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-01f2075f-8c84-48cb-8952-9c03fc7c079b tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Flavor pref 0:0:0 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:28:46.674665 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-01f2075f-8c84-48cb-8952-9c03fc7c079b tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Image pref 0:0:0 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:28:46.675264 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-01f2075f-8c84-48cb-8952-9c03fc7c079b tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:28:46.687024 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-01f2075f-8c84-48cb-8952-9c03fc7c079b tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:46.687983 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-01f2075f-8c84-48cb-8952-9c03fc7c079b tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:46.688601 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-01f2075f-8c84-48cb-8952-9c03fc7c079b tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:46.689588 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-01f2075f-8c84-48cb-8952-9c03fc7c079b tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:46.690364 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-01f2075f-8c84-48cb-8952-9c03fc7c079b tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:46.691273 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-01f2075f-8c84-48cb-8952-9c03fc7c079b tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:46.695573 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.compute.server_external_events [req-5a2c69fb-06f0-49c8-a8db-88f92ff87dcf req-f42ea48a-3462-4ff9-a33b-a72e2657e599 service nova] Creating event network-changed:b6386749-9042-42f7-933e-fe24b60012ef for instance 9fb59350-4f09-4e20-bddb-ffc9a65897b3 on hv-cinder-84630 Aug 27 02:28:46.706161 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [req-5a2c69fb-06f0-49c8-a8db-88f92ff87dcf req-f42ea48a-3462-4ff9-a33b-a72e2657e599 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054165 Aug 27 02:28:46.706776 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 501/1023] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Aug 27 02:28:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:28:46.715867 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.quota [None req-01f2075f-8c84-48cb-8952-9c03fc7c079b tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Getting quotas for project 48950f3d194a467e81bc74adfca6d94f. Resources: {'instances', 'ram', 'cores'} {{(pid=120782) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:28:46.718725 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-a3d0c3e9-2dc0-4239-a9aa-a581da25449a tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:46.719649 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-a3d0c3e9-2dc0-4239-a9aa-a581da25449a tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] [instance: 9fb59350-4f09-4e20-bddb-ffc9a65897b3] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:46.721678 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.quota [None req-01f2075f-8c84-48cb-8952-9c03fc7c079b tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Getting quotas for user 6fab0689ace84088890202583f75dc3e and project 48950f3d194a467e81bc74adfca6d94f. Resources: {'instances', 'ram', 'cores'} {{(pid=120782) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:28:46.727243 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a3d0c3e9-2dc0-4239-a9aa-a581da25449a tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:46.727879 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a3d0c3e9-2dc0-4239-a9aa-a581da25449a tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:46.728409 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a3d0c3e9-2dc0-4239-a9aa-a581da25449a tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:46.729389 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a3d0c3e9-2dc0-4239-a9aa-a581da25449a tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:46.730100 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a3d0c3e9-2dc0-4239-a9aa-a581da25449a tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:46.730734 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a3d0c3e9-2dc0-4239-a9aa-a581da25449a tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:46.738776 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-01f2075f-8c84-48cb-8952-9c03fc7c079b tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Going to run 1 instances... {{(pid=120782) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:28:46.741605 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-01f2075f-8c84-48cb-8952-9c03fc7c079b tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] [instance: b94a90e1-180f-4f18-bad5-f4ecfbce94b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7d45cdd6-750f-40c7-9475-f7bf12fcb204',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120782) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:28:46.898264 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-a3d0c3e9-2dc0-4239-a9aa-a581da25449a tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f53d57f3544e5a25e1beeddab9af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2d4ae1c228446eb5bfc64d44348fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:46.907027 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-a3d0c3e9-2dc0-4239-a9aa-a581da25449a tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] 10.222.0.61 "GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3" status: 200 len: 1570 microversion: 2.1 time: 0.197779 Aug 27 02:28:46.907958 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 502/1024] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:28:46 2022] GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3 => generated 1570 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:28:47.127960 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-01f2075f-8c84-48cb-8952-9c03fc7c079b tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.286330 Aug 27 02:28:47.134268 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 523/1025] 10.222.0.61 () {60 vars in 1147 bytes} [Sat Aug 27 02:28:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1288 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:28:47.144281 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-dbda690c-8c1d-499c-bdba-f61ed9fc50b6 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:47.160364 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-dbda690c-8c1d-499c-bdba-f61ed9fc50b6 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] [instance: b94a90e1-180f-4f18-bad5-f4ecfbce94b2] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:47.270175 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-dbda690c-8c1d-499c-bdba-f61ed9fc50b6 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fab0689ace84088890202583f75dc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48950f3d194a467e81bc74adfca6d94f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:47.280766 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-dbda690c-8c1d-499c-bdba-f61ed9fc50b6 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] 10.222.0.61 "GET /compute/v2.1/servers/b94a90e1-180f-4f18-bad5-f4ecfbce94b2" status: 200 len: 1214 microversion: 2.1 time: 0.144003 Aug 27 02:28:47.287037 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 503/1026] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:28:47 2022] GET /compute/v2.1/servers/b94a90e1-180f-4f18-bad5-f4ecfbce94b2 => generated 1214 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:28:47.932012 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-75f388d5-2c90-49f1-acd9-fae30bdad325 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:47.932854 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-75f388d5-2c90-49f1-acd9-fae30bdad325 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] [instance: 9fb59350-4f09-4e20-bddb-ffc9a65897b3] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:47.940123 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-75f388d5-2c90-49f1-acd9-fae30bdad325 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:47.940687 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-75f388d5-2c90-49f1-acd9-fae30bdad325 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:47.941123 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-75f388d5-2c90-49f1-acd9-fae30bdad325 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:47.941859 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-75f388d5-2c90-49f1-acd9-fae30bdad325 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:47.942309 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-75f388d5-2c90-49f1-acd9-fae30bdad325 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:47.942732 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-75f388d5-2c90-49f1-acd9-fae30bdad325 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:48.104506 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-75f388d5-2c90-49f1-acd9-fae30bdad325 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f53d57f3544e5a25e1beeddab9af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2d4ae1c228446eb5bfc64d44348fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:48.125332 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-75f388d5-2c90-49f1-acd9-fae30bdad325 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] 10.222.0.61 "GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3" status: 200 len: 1570 microversion: 2.1 time: 0.199177 Aug 27 02:28:48.126101 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 524/1027] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:28:47 2022] GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3 => generated 1570 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:28:48.305508 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-5b039ae5-e719-4ebb-b679-05a17341291a tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:48.306651 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-5b039ae5-e719-4ebb-b679-05a17341291a tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] [instance: b94a90e1-180f-4f18-bad5-f4ecfbce94b2] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:48.321386 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5b039ae5-e719-4ebb-b679-05a17341291a tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:48.323169 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5b039ae5-e719-4ebb-b679-05a17341291a tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:48.323674 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5b039ae5-e719-4ebb-b679-05a17341291a tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:48.324904 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5b039ae5-e719-4ebb-b679-05a17341291a tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:48.326078 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5b039ae5-e719-4ebb-b679-05a17341291a tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:48.327304 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5b039ae5-e719-4ebb-b679-05a17341291a tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:48.487619 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-5b039ae5-e719-4ebb-b679-05a17341291a tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fab0689ace84088890202583f75dc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48950f3d194a467e81bc74adfca6d94f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:48.502628 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-5b039ae5-e719-4ebb-b679-05a17341291a tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] 10.222.0.61 "GET /compute/v2.1/servers/b94a90e1-180f-4f18-bad5-f4ecfbce94b2" status: 200 len: 1266 microversion: 2.1 time: 0.203724 Aug 27 02:28:48.503877 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 504/1028] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:28:48 2022] GET /compute/v2.1/servers/b94a90e1-180f-4f18-bad5-f4ecfbce94b2 => generated 1266 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:28:49.122639 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [req-ed9526f0-5e4e-4275-a55b-3c8560e85757 req-daed5a12-b468-46c0-bc32-1fcf955183d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fb59350-4f09-4e20-bddb-ffc9a65897b3", "name": "network-vif-deleted", "tag": "b6386749-9042-42f7-933e-fe24b60012ef"}]} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:28:49.148741 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-82900410-f71d-47c0-b91a-e330a383fb85 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:49.149435 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-82900410-f71d-47c0-b91a-e330a383fb85 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] [instance: 9fb59350-4f09-4e20-bddb-ffc9a65897b3] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:49.156613 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-82900410-f71d-47c0-b91a-e330a383fb85 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:49.157741 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-82900410-f71d-47c0-b91a-e330a383fb85 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:49.158633 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-82900410-f71d-47c0-b91a-e330a383fb85 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:49.158801 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-ed9526f0-5e4e-4275-a55b-3c8560e85757 req-daed5a12-b468-46c0-bc32-1fcf955183d5 service nova] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:49.159583 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-ed9526f0-5e4e-4275-a55b-3c8560e85757 req-daed5a12-b468-46c0-bc32-1fcf955183d5 service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:49.159716 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-82900410-f71d-47c0-b91a-e330a383fb85 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:49.160227 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-82900410-f71d-47c0-b91a-e330a383fb85 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:49.160465 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-ed9526f0-5e4e-4275-a55b-3c8560e85757 req-daed5a12-b468-46c0-bc32-1fcf955183d5 service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:49.160787 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-82900410-f71d-47c0-b91a-e330a383fb85 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:49.184768 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.compute.server_external_events [req-ed9526f0-5e4e-4275-a55b-3c8560e85757 req-daed5a12-b468-46c0-bc32-1fcf955183d5 service nova] Creating event network-vif-deleted:b6386749-9042-42f7-933e-fe24b60012ef for instance 9fb59350-4f09-4e20-bddb-ffc9a65897b3 on hv-cinder-84630 Aug 27 02:28:49.196697 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [req-ed9526f0-5e4e-4275-a55b-3c8560e85757 req-daed5a12-b468-46c0-bc32-1fcf955183d5 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078644 Aug 27 02:28:49.200938 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 525/1029] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Aug 27 02:28:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:28:49.277246 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-82900410-f71d-47c0-b91a-e330a383fb85 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f53d57f3544e5a25e1beeddab9af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2d4ae1c228446eb5bfc64d44348fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:49.306018 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-82900410-f71d-47c0-b91a-e330a383fb85 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] 10.222.0.61 "GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3" status: 200 len: 1503 microversion: 2.1 time: 0.161086 Aug 27 02:28:49.323009 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 505/1030] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:28:49 2022] GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3 => generated 1503 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:28:49.530118 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-dced08f1-2b08-4307-81e5-41ffac89c5db tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:49.532116 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-dced08f1-2b08-4307-81e5-41ffac89c5db tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] [instance: b94a90e1-180f-4f18-bad5-f4ecfbce94b2] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:49.541212 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-dced08f1-2b08-4307-81e5-41ffac89c5db tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:49.542018 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-dced08f1-2b08-4307-81e5-41ffac89c5db tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:49.542604 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-dced08f1-2b08-4307-81e5-41ffac89c5db tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:49.543888 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-dced08f1-2b08-4307-81e5-41ffac89c5db tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:49.544565 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-dced08f1-2b08-4307-81e5-41ffac89c5db tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:49.544983 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-dced08f1-2b08-4307-81e5-41ffac89c5db tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:49.689494 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-dced08f1-2b08-4307-81e5-41ffac89c5db tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fab0689ace84088890202583f75dc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48950f3d194a467e81bc74adfca6d94f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:49.709728 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-dced08f1-2b08-4307-81e5-41ffac89c5db tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] 10.222.0.61 "GET /compute/v2.1/servers/b94a90e1-180f-4f18-bad5-f4ecfbce94b2" status: 200 len: 1272 microversion: 2.1 time: 0.188011 Aug 27 02:28:49.711918 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 526/1031] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:28:49 2022] GET /compute/v2.1/servers/b94a90e1-180f-4f18-bad5-f4ecfbce94b2 => generated 1272 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:28:50.343393 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-b454f7eb-fb1a-4259-b8ba-d8d32d1fa680 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:50.344803 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-b454f7eb-fb1a-4259-b8ba-d8d32d1fa680 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] [instance: 9fb59350-4f09-4e20-bddb-ffc9a65897b3] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:50.352234 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b454f7eb-fb1a-4259-b8ba-d8d32d1fa680 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:50.352869 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b454f7eb-fb1a-4259-b8ba-d8d32d1fa680 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:50.353311 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b454f7eb-fb1a-4259-b8ba-d8d32d1fa680 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:50.354080 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b454f7eb-fb1a-4259-b8ba-d8d32d1fa680 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:50.354534 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b454f7eb-fb1a-4259-b8ba-d8d32d1fa680 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:50.354962 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b454f7eb-fb1a-4259-b8ba-d8d32d1fa680 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:50.370569 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.wsgi [None req-b454f7eb-fb1a-4259-b8ba-d8d32d1fa680 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] HTTP exception thrown: Instance 9fb59350-4f09-4e20-bddb-ffc9a65897b3 could not be found. Aug 27 02:28:50.372254 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-b454f7eb-fb1a-4259-b8ba-d8d32d1fa680 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Request method failure captured: Aug 27 02:28:50.372254 dv-cinder-846303-3-smb devstack@n-api.service[120783]: request: GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3 HTTP/1.1 Aug 27 02:28:50.372254 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Accept: application/json Aug 27 02:28:50.372254 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Accept-Encoding: identity Aug 27 02:28:50.372254 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Connection: close Aug 27 02:28:50.372254 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Content-Length: 0 Aug 27 02:28:50.372254 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Content-Type: application/json Aug 27 02:28:50.372254 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Host: 10.222.0.61 Aug 27 02:28:50.372254 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Openstack-System-Scope: None Aug 27 02:28:50.372254 dv-cinder-846303-3-smb devstack@n-api.service[120783]: User-Agent: python-urllib3/1.26.11 Aug 27 02:28:50.372254 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Auth-Token: gAAAAABjCYAG5IO8LIvyWONWq9Dv9RZ5Ag7lnr6kDn8enKWn7q9lYR6nxsE73NU_KyQAg_NXMgi6O7gfSoHDfcrdGIJ6cUS7KKrK2C98E-mziI6z3HzdfQU4057DKmEyX4lJXUM_BDzgYqpBENCYe9RaNtzcFQnKlPli6aQWncgSsdErq0fM_vE Aug 27 02:28:50.372254 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Domain-Id: None Aug 27 02:28:50.372254 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Domain-Name: None Aug 27 02:28:50.372254 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Identity-Status: Confirmed Aug 27 02:28:50.372254 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Is-Admin-Project: True Aug 27 02:28:50.372254 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Project-Domain-Id: default Aug 27 02:28:50.372254 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Project-Domain-Name: Default Aug 27 02:28:50.372254 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Project-Id: fd2d4ae1c228446eb5bfc64d44348fdf Aug 27 02:28:50.372254 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Project-Name: tempest-TestShelveInstance-379161740 Aug 27 02:28:50.372254 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Role: member,reader Aug 27 02:28:50.372254 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Roles: member,reader Aug 27 02:28:50.378250 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/fd2d4ae1c228446eb5bfc64d44348fdf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_fd2d4ae1c228446eb5bfc64d44348fdf", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fd2d4ae1c228446eb5bfc64d44348fdf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fd2d4ae1c228446eb5bfc64d44348fdf"}]}] Aug 27 02:28:50.378250 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Tenant: tempest-TestShelveInstance-379161740 Aug 27 02:28:50.378250 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Tenant-Id: fd2d4ae1c228446eb5bfc64d44348fdf Aug 27 02:28:50.378250 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Tenant-Name: tempest-TestShelveInstance-379161740 Aug 27 02:28:50.378250 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User: tempest-TestShelveInstance-379161740-project Aug 27 02:28:50.378250 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User-Domain-Id: default Aug 27 02:28:50.378250 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User-Domain-Name: Default Aug 27 02:28:50.378250 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User-Id: ef7f53d57f3544e5a25e1beeddab9af4 Aug 27 02:28:50.378250 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User-Name: tempest-TestShelveInstance-379161740-project Aug 27 02:28:50.378250 dv-cinder-846303-3-smb devstack@n-api.service[120783]: method: > Aug 27 02:28:50.378250 dv-cinder-846303-3-smb devstack@n-api.service[120783]: exception: Instance 9fb59350-4f09-4e20-bddb-ffc9a65897b3 could not be found. Aug 27 02:28:50.378250 dv-cinder-846303-3-smb devstack@n-api.service[120783]: action_args: {'id': '9fb59350-4f09-4e20-bddb-ffc9a65897b3'} Aug 27 02:28:50.379762 dv-cinder-846303-3-smb devstack@n-api.service[120783]: {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:28:50.379762 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:50.379762 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:28:50.379762 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:28:50.379762 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:28:50.379762 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:28:50.379762 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:28:50.379762 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:28:50.379762 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:28:50.379762 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:28:50.379762 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fb59350-4f09-4e20-bddb-ffc9a65897b3 could not be found. Aug 27 02:28:50.379762 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:28:50.379762 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:28:50.379762 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:28:50.379762 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:50.379762 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:50.379762 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:50.379762 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:28:50.379762 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:28:50.379762 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:28:50.382887 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:28:50.382887 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:28:50.382887 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:28:50.382887 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:28:50.382887 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:28:50.382887 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:28:50.382887 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:28:50.382887 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fb59350-4f09-4e20-bddb-ffc9a65897b3 could not be found. Aug 27 02:28:50.382887 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:28:50.382887 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:28:50.382887 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:28:50.382887 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:50.382887 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:50.382887 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:50.382887 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:28:50.382887 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:28:50.382887 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fb59350-4f09-4e20-bddb-ffc9a65897b3 could not be found. Aug 27 02:28:50.382887 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:28:50.385818 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-b454f7eb-fb1a-4259-b8ba-d8d32d1fa680 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Returning 404 to user: Instance 9fb59350-4f09-4e20-bddb-ffc9a65897b3 could not be found. {{(pid=120783) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:28:50.385818 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-b454f7eb-fb1a-4259-b8ba-d8d32d1fa680 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] 10.222.0.61 "GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3" status: 404 len: 111 microversion: 2.1 time: 0.034742 Aug 27 02:28:50.385818 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 506/1032] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:28:50 2022] GET /compute/v2.1/servers/9fb59350-4f09-4e20-bddb-ffc9a65897b3 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:28:50.566730 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-a50afbfb-332c-4857-8d33-9791177f6098 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] Calling method '.version_select at 0x7fd808459670>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:50.616391 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-a50afbfb-332c-4857-8d33-9791177f6098 tempest-TestShelveInstance-379161740 tempest-TestShelveInstance-379161740-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1212741542" status: 202 len: 0 microversion: 2.1 time: 0.055777 Aug 27 02:28:50.617297 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 527/1033] 10.222.0.61 () {58 vars in 1254 bytes} [Sat Aug 27 02:28:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1212741542 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:28:50.742085 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-a11357d4-a6ff-4ae4-90ba-8c32907059dd tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:50.743091 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-a11357d4-a6ff-4ae4-90ba-8c32907059dd tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] [instance: b94a90e1-180f-4f18-bad5-f4ecfbce94b2] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:50.751630 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a11357d4-a6ff-4ae4-90ba-8c32907059dd tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:50.752465 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a11357d4-a6ff-4ae4-90ba-8c32907059dd tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:50.753841 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a11357d4-a6ff-4ae4-90ba-8c32907059dd tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:50.755581 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a11357d4-a6ff-4ae4-90ba-8c32907059dd tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:50.756871 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a11357d4-a6ff-4ae4-90ba-8c32907059dd tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:50.758036 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a11357d4-a6ff-4ae4-90ba-8c32907059dd tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:51.095934 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [req-02149736-3ac5-4a6e-8279-d912fb517ce2 req-8406aea2-89a8-4b25-aa79-637fe5d08132 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b94a90e1-180f-4f18-bad5-f4ecfbce94b2", "tag": "32d82474-0ee4-4f87-828b-637eb7308b94"}]} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:28:51.102045 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-a11357d4-a6ff-4ae4-90ba-8c32907059dd tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fab0689ace84088890202583f75dc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48950f3d194a467e81bc74adfca6d94f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:51.111789 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-02149736-3ac5-4a6e-8279-d912fb517ce2 req-8406aea2-89a8-4b25-aa79-637fe5d08132 service nova] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:51.113701 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-a11357d4-a6ff-4ae4-90ba-8c32907059dd tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] 10.222.0.61 "GET /compute/v2.1/servers/b94a90e1-180f-4f18-bad5-f4ecfbce94b2" status: 200 len: 1314 microversion: 2.1 time: 0.380079 Aug 27 02:28:51.118786 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 507/1034] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:28:50 2022] GET /compute/v2.1/servers/b94a90e1-180f-4f18-bad5-f4ecfbce94b2 => generated 1314 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:28:51.119714 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-02149736-3ac5-4a6e-8279-d912fb517ce2 req-8406aea2-89a8-4b25-aa79-637fe5d08132 service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:51.120758 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-02149736-3ac5-4a6e-8279-d912fb517ce2 req-8406aea2-89a8-4b25-aa79-637fe5d08132 service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:51.139630 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.compute.server_external_events [req-02149736-3ac5-4a6e-8279-d912fb517ce2 req-8406aea2-89a8-4b25-aa79-637fe5d08132 service nova] Creating event network-changed:32d82474-0ee4-4f87-828b-637eb7308b94 for instance b94a90e1-180f-4f18-bad5-f4ecfbce94b2 on hv-cinder-84630 Aug 27 02:28:51.146454 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [req-02149736-3ac5-4a6e-8279-d912fb517ce2 req-8406aea2-89a8-4b25-aa79-637fe5d08132 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.317281 Aug 27 02:28:51.147614 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 528/1035] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Aug 27 02:28:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:28:52.146094 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-b905ee69-627e-45dd-bf2a-b271379a1f4d tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:52.146874 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-b905ee69-627e-45dd-bf2a-b271379a1f4d tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] [instance: b94a90e1-180f-4f18-bad5-f4ecfbce94b2] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:52.154685 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b905ee69-627e-45dd-bf2a-b271379a1f4d tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:52.155458 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b905ee69-627e-45dd-bf2a-b271379a1f4d tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:52.155892 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b905ee69-627e-45dd-bf2a-b271379a1f4d tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:52.156687 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b905ee69-627e-45dd-bf2a-b271379a1f4d tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:52.157182 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b905ee69-627e-45dd-bf2a-b271379a1f4d tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:52.157647 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b905ee69-627e-45dd-bf2a-b271379a1f4d tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:52.403832 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-b905ee69-627e-45dd-bf2a-b271379a1f4d tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fab0689ace84088890202583f75dc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48950f3d194a467e81bc74adfca6d94f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:52.412401 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-b905ee69-627e-45dd-bf2a-b271379a1f4d tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] 10.222.0.61 "GET /compute/v2.1/servers/b94a90e1-180f-4f18-bad5-f4ecfbce94b2" status: 200 len: 1314 microversion: 2.1 time: 0.270316 Aug 27 02:28:52.421445 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 508/1036] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:28:52 2022] GET /compute/v2.1/servers/b94a90e1-180f-4f18-bad5-f4ecfbce94b2 => generated 1314 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:28:53.435909 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-42b990bc-19fa-4d5e-abbb-eaf8ea29b643 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:53.436733 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-42b990bc-19fa-4d5e-abbb-eaf8ea29b643 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] [instance: b94a90e1-180f-4f18-bad5-f4ecfbce94b2] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:53.443412 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-42b990bc-19fa-4d5e-abbb-eaf8ea29b643 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:53.443887 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-42b990bc-19fa-4d5e-abbb-eaf8ea29b643 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:53.444340 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-42b990bc-19fa-4d5e-abbb-eaf8ea29b643 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:53.445043 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-42b990bc-19fa-4d5e-abbb-eaf8ea29b643 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:53.445528 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-42b990bc-19fa-4d5e-abbb-eaf8ea29b643 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:53.445959 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-42b990bc-19fa-4d5e-abbb-eaf8ea29b643 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:53.648747 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-42b990bc-19fa-4d5e-abbb-eaf8ea29b643 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fab0689ace84088890202583f75dc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48950f3d194a467e81bc74adfca6d94f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:53.658138 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-42b990bc-19fa-4d5e-abbb-eaf8ea29b643 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] 10.222.0.61 "GET /compute/v2.1/servers/b94a90e1-180f-4f18-bad5-f4ecfbce94b2" status: 200 len: 1314 microversion: 2.1 time: 0.227371 Aug 27 02:28:53.658917 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 529/1037] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:28:53 2022] GET /compute/v2.1/servers/b94a90e1-180f-4f18-bad5-f4ecfbce94b2 => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:28:54.685929 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-c46256de-ba5c-4fd8-8ba3-883389c033ad tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:54.687880 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-c46256de-ba5c-4fd8-8ba3-883389c033ad tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] [instance: b94a90e1-180f-4f18-bad5-f4ecfbce94b2] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:54.699475 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c46256de-ba5c-4fd8-8ba3-883389c033ad tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:54.700815 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c46256de-ba5c-4fd8-8ba3-883389c033ad tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:54.701665 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c46256de-ba5c-4fd8-8ba3-883389c033ad tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:54.703189 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c46256de-ba5c-4fd8-8ba3-883389c033ad tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:54.704472 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c46256de-ba5c-4fd8-8ba3-883389c033ad tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:54.704970 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c46256de-ba5c-4fd8-8ba3-883389c033ad tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:54.925214 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-c46256de-ba5c-4fd8-8ba3-883389c033ad tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fab0689ace84088890202583f75dc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48950f3d194a467e81bc74adfca6d94f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:54.941856 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-c46256de-ba5c-4fd8-8ba3-883389c033ad tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] 10.222.0.61 "GET /compute/v2.1/servers/b94a90e1-180f-4f18-bad5-f4ecfbce94b2" status: 200 len: 1314 microversion: 2.1 time: 0.260822 Aug 27 02:28:54.943216 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 509/1038] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:28:54 2022] GET /compute/v2.1/servers/b94a90e1-180f-4f18-bad5-f4ecfbce94b2 => generated 1314 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:28:55.964107 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-d692b0df-990e-49a4-8969-e548bd7151d8 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:55.965003 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-d692b0df-990e-49a4-8969-e548bd7151d8 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] [instance: b94a90e1-180f-4f18-bad5-f4ecfbce94b2] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:55.973381 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d692b0df-990e-49a4-8969-e548bd7151d8 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:55.974032 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d692b0df-990e-49a4-8969-e548bd7151d8 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:55.974471 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d692b0df-990e-49a4-8969-e548bd7151d8 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:55.975175 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d692b0df-990e-49a4-8969-e548bd7151d8 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:55.975808 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d692b0df-990e-49a4-8969-e548bd7151d8 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:55.976397 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d692b0df-990e-49a4-8969-e548bd7151d8 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:56.488653 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-d692b0df-990e-49a4-8969-e548bd7151d8 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fab0689ace84088890202583f75dc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48950f3d194a467e81bc74adfca6d94f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:56.500373 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-d692b0df-990e-49a4-8969-e548bd7151d8 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] 10.222.0.61 "GET /compute/v2.1/servers/b94a90e1-180f-4f18-bad5-f4ecfbce94b2" status: 200 len: 1314 microversion: 2.1 time: 0.539878 Aug 27 02:28:56.502049 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 530/1039] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:28:55 2022] GET /compute/v2.1/servers/b94a90e1-180f-4f18-bad5-f4ecfbce94b2 => generated 1314 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:28:57.532638 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-43026f9a-3b5b-48a0-a926-423378b941fa tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:57.534008 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-43026f9a-3b5b-48a0-a926-423378b941fa tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] [instance: b94a90e1-180f-4f18-bad5-f4ecfbce94b2] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:57.536914 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell0:SELECT=2 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:57.548023 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-43026f9a-3b5b-48a0-a926-423378b941fa tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:57.556263 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-43026f9a-3b5b-48a0-a926-423378b941fa tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:57.557014 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-43026f9a-3b5b-48a0-a926-423378b941fa tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:57.558334 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-43026f9a-3b5b-48a0-a926-423378b941fa tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:57.559173 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-43026f9a-3b5b-48a0-a926-423378b941fa tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:57.559983 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-43026f9a-3b5b-48a0-a926-423378b941fa tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:57.736838 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-43026f9a-3b5b-48a0-a926-423378b941fa tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fab0689ace84088890202583f75dc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48950f3d194a467e81bc74adfca6d94f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:57.750229 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-43026f9a-3b5b-48a0-a926-423378b941fa tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] 10.222.0.61 "GET /compute/v2.1/servers/b94a90e1-180f-4f18-bad5-f4ecfbce94b2" status: 200 len: 1314 microversion: 2.1 time: 0.222768 Aug 27 02:28:57.751231 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 510/1040] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:28:57 2022] GET /compute/v2.1/servers/b94a90e1-180f-4f18-bad5-f4ecfbce94b2 => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:28:58.220748 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [req-40682254-b378-4a5c-af79-e91f03dbcdb7 req-d1a053bd-c2cc-4f01-9e2f-15a33e98e991 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b94a90e1-180f-4f18-bad5-f4ecfbce94b2", "name": "network-vif-plugged", "status": "completed", "tag": "32d82474-0ee4-4f87-828b-637eb7308b94"}]} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:28:58.231577 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell0:SELECT=2 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:58.232661 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell0:SELECT=6 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:58.236242 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-40682254-b378-4a5c-af79-e91f03dbcdb7 req-d1a053bd-c2cc-4f01-9e2f-15a33e98e991 service nova] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:58.236994 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-40682254-b378-4a5c-af79-e91f03dbcdb7 req-d1a053bd-c2cc-4f01-9e2f-15a33e98e991 service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:58.237669 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-40682254-b378-4a5c-af79-e91f03dbcdb7 req-d1a053bd-c2cc-4f01-9e2f-15a33e98e991 service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:58.256045 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.compute.server_external_events [req-40682254-b378-4a5c-af79-e91f03dbcdb7 req-d1a053bd-c2cc-4f01-9e2f-15a33e98e991 service nova] Creating event network-vif-plugged:32d82474-0ee4-4f87-828b-637eb7308b94 for instance b94a90e1-180f-4f18-bad5-f4ecfbce94b2 on hv-cinder-84630 Aug 27 02:28:58.269087 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [req-40682254-b378-4a5c-af79-e91f03dbcdb7 req-d1a053bd-c2cc-4f01-9e2f-15a33e98e991 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053270 Aug 27 02:28:58.271920 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 531/1041] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Aug 27 02:28:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:28:58.775051 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-eaa2fd05-82b0-45a8-8566-6ae66055072a tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:58.775965 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-eaa2fd05-82b0-45a8-8566-6ae66055072a tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] [instance: b94a90e1-180f-4f18-bad5-f4ecfbce94b2] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:58.784310 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-eaa2fd05-82b0-45a8-8566-6ae66055072a tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:58.786584 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-eaa2fd05-82b0-45a8-8566-6ae66055072a tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:58.787312 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-eaa2fd05-82b0-45a8-8566-6ae66055072a tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:58.788577 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-eaa2fd05-82b0-45a8-8566-6ae66055072a tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:58.789254 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-eaa2fd05-82b0-45a8-8566-6ae66055072a tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:58.790112 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-eaa2fd05-82b0-45a8-8566-6ae66055072a tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:58.964070 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-eaa2fd05-82b0-45a8-8566-6ae66055072a tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fab0689ace84088890202583f75dc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48950f3d194a467e81bc74adfca6d94f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:58.972707 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-eaa2fd05-82b0-45a8-8566-6ae66055072a tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] 10.222.0.61 "GET /compute/v2.1/servers/b94a90e1-180f-4f18-bad5-f4ecfbce94b2" status: 200 len: 1314 microversion: 2.1 time: 0.204753 Aug 27 02:28:58.973427 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 511/1042] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:28:58 2022] GET /compute/v2.1/servers/b94a90e1-180f-4f18-bad5-f4ecfbce94b2 => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:28:59.995262 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-c32b1412-c37e-4779-904c-cdf17c2cf551 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:59.995934 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-c32b1412-c37e-4779-904c-cdf17c2cf551 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] [instance: b94a90e1-180f-4f18-bad5-f4ecfbce94b2] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:00.002877 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c32b1412-c37e-4779-904c-cdf17c2cf551 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:00.003421 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c32b1412-c37e-4779-904c-cdf17c2cf551 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:00.003811 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c32b1412-c37e-4779-904c-cdf17c2cf551 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:00.004518 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c32b1412-c37e-4779-904c-cdf17c2cf551 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:00.004974 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c32b1412-c37e-4779-904c-cdf17c2cf551 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:00.005438 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c32b1412-c37e-4779-904c-cdf17c2cf551 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:00.146427 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-c32b1412-c37e-4779-904c-cdf17c2cf551 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fab0689ace84088890202583f75dc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48950f3d194a467e81bc74adfca6d94f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:00.154405 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-c32b1412-c37e-4779-904c-cdf17c2cf551 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] 10.222.0.61 "GET /compute/v2.1/servers/b94a90e1-180f-4f18-bad5-f4ecfbce94b2" status: 200 len: 1314 microversion: 2.1 time: 0.164205 Aug 27 02:29:00.154954 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 532/1043] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:28:59 2022] GET /compute/v2.1/servers/b94a90e1-180f-4f18-bad5-f4ecfbce94b2 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:29:01.176200 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-ddc188b0-c312-4cd0-b21b-2c6e2b4e1132 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:01.176883 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-ddc188b0-c312-4cd0-b21b-2c6e2b4e1132 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] [instance: b94a90e1-180f-4f18-bad5-f4ecfbce94b2] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:01.183616 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ddc188b0-c312-4cd0-b21b-2c6e2b4e1132 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:01.184095 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ddc188b0-c312-4cd0-b21b-2c6e2b4e1132 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:01.184550 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ddc188b0-c312-4cd0-b21b-2c6e2b4e1132 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:01.185242 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ddc188b0-c312-4cd0-b21b-2c6e2b4e1132 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:01.185787 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ddc188b0-c312-4cd0-b21b-2c6e2b4e1132 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:01.186207 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ddc188b0-c312-4cd0-b21b-2c6e2b4e1132 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:01.322360 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-ddc188b0-c312-4cd0-b21b-2c6e2b4e1132 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fab0689ace84088890202583f75dc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48950f3d194a467e81bc74adfca6d94f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:01.330454 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-ddc188b0-c312-4cd0-b21b-2c6e2b4e1132 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] 10.222.0.61 "GET /compute/v2.1/servers/b94a90e1-180f-4f18-bad5-f4ecfbce94b2" status: 200 len: 1497 microversion: 2.1 time: 0.158900 Aug 27 02:29:01.331033 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 512/1044] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:29:01 2022] GET /compute/v2.1/servers/b94a90e1-180f-4f18-bad5-f4ecfbce94b2 => generated 1497 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:29:01.782139 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-32e859e7-bea5-46b8-a6a8-535aea9b4b86 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:01.782725 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-32e859e7-bea5-46b8-a6a8-535aea9b4b86 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] [instance: b94a90e1-180f-4f18-bad5-f4ecfbce94b2] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:01.789691 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-32e859e7-bea5-46b8-a6a8-535aea9b4b86 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:01.790175 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-32e859e7-bea5-46b8-a6a8-535aea9b4b86 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:01.790601 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-32e859e7-bea5-46b8-a6a8-535aea9b4b86 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:01.791284 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-32e859e7-bea5-46b8-a6a8-535aea9b4b86 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:01.791803 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-32e859e7-bea5-46b8-a6a8-535aea9b4b86 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:01.792247 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-32e859e7-bea5-46b8-a6a8-535aea9b4b86 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:01.823331 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-32e859e7-bea5-46b8-a6a8-535aea9b4b86 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] [instance: b94a90e1-180f-4f18-bad5-f4ecfbce94b2] Going to try to terminate instance {{(pid=120782) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:29:01.909641 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-32e859e7-bea5-46b8-a6a8-535aea9b4b86 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] 10.222.0.61 "DELETE /compute/v2.1/servers/b94a90e1-180f-4f18-bad5-f4ecfbce94b2" status: 204 len: 0 microversion: 2.1 time: 0.130844 Aug 27 02:29:01.911174 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 533/1045] 10.222.0.61 () {58 vars in 1239 bytes} [Sat Aug 27 02:29:01 2022] DELETE /compute/v2.1/servers/b94a90e1-180f-4f18-bad5-f4ecfbce94b2 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:29:01.919016 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-530d7936-88f5-4df0-ba5f-6171f658db0f tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:01.919621 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-530d7936-88f5-4df0-ba5f-6171f658db0f tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] [instance: b94a90e1-180f-4f18-bad5-f4ecfbce94b2] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:01.929254 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-530d7936-88f5-4df0-ba5f-6171f658db0f tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:01.929777 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-530d7936-88f5-4df0-ba5f-6171f658db0f tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:01.930208 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-530d7936-88f5-4df0-ba5f-6171f658db0f tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:01.930940 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-530d7936-88f5-4df0-ba5f-6171f658db0f tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:01.931392 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-530d7936-88f5-4df0-ba5f-6171f658db0f tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:01.931769 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-530d7936-88f5-4df0-ba5f-6171f658db0f tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:02.067487 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-530d7936-88f5-4df0-ba5f-6171f658db0f tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fab0689ace84088890202583f75dc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48950f3d194a467e81bc74adfca6d94f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:02.076221 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-530d7936-88f5-4df0-ba5f-6171f658db0f tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] 10.222.0.61 "GET /compute/v2.1/servers/b94a90e1-180f-4f18-bad5-f4ecfbce94b2" status: 200 len: 1503 microversion: 2.1 time: 0.161001 Aug 27 02:29:02.076797 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 513/1046] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:29:01 2022] GET /compute/v2.1/servers/b94a90e1-180f-4f18-bad5-f4ecfbce94b2 => generated 1503 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:29:03.097550 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-f9de1d33-9543-4c87-87b5-a9bf0c0137da tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:03.098395 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-f9de1d33-9543-4c87-87b5-a9bf0c0137da tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] [instance: b94a90e1-180f-4f18-bad5-f4ecfbce94b2] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:03.106766 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f9de1d33-9543-4c87-87b5-a9bf0c0137da tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:03.107554 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f9de1d33-9543-4c87-87b5-a9bf0c0137da tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:03.108170 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f9de1d33-9543-4c87-87b5-a9bf0c0137da tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:03.108885 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f9de1d33-9543-4c87-87b5-a9bf0c0137da tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:03.110166 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f9de1d33-9543-4c87-87b5-a9bf0c0137da tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:03.110950 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f9de1d33-9543-4c87-87b5-a9bf0c0137da tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:03.300797 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-f9de1d33-9543-4c87-87b5-a9bf0c0137da tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fab0689ace84088890202583f75dc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48950f3d194a467e81bc74adfca6d94f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:03.310141 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-f9de1d33-9543-4c87-87b5-a9bf0c0137da tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] 10.222.0.61 "GET /compute/v2.1/servers/b94a90e1-180f-4f18-bad5-f4ecfbce94b2" status: 200 len: 1503 microversion: 2.1 time: 0.216743 Aug 27 02:29:03.310722 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 534/1047] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:29:03 2022] GET /compute/v2.1/servers/b94a90e1-180f-4f18-bad5-f4ecfbce94b2 => generated 1503 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:29:03.890978 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [req-331d2ecf-5a87-4bae-9a1c-93f2fb101dff req-ae9d896d-39fb-45c5-a0fe-d4056feb8258 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b94a90e1-180f-4f18-bad5-f4ecfbce94b2", "name": "network-vif-deleted", "tag": "32d82474-0ee4-4f87-828b-637eb7308b94"}]} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:29:03.901746 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-331d2ecf-5a87-4bae-9a1c-93f2fb101dff req-ae9d896d-39fb-45c5-a0fe-d4056feb8258 service nova] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:03.902225 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-331d2ecf-5a87-4bae-9a1c-93f2fb101dff req-ae9d896d-39fb-45c5-a0fe-d4056feb8258 service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:03.902649 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-331d2ecf-5a87-4bae-9a1c-93f2fb101dff req-ae9d896d-39fb-45c5-a0fe-d4056feb8258 service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:03.915268 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.compute.server_external_events [req-331d2ecf-5a87-4bae-9a1c-93f2fb101dff req-ae9d896d-39fb-45c5-a0fe-d4056feb8258 service nova] Creating event network-vif-deleted:32d82474-0ee4-4f87-828b-637eb7308b94 for instance b94a90e1-180f-4f18-bad5-f4ecfbce94b2 on hv-cinder-84630 Aug 27 02:29:03.921084 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [req-331d2ecf-5a87-4bae-9a1c-93f2fb101dff req-ae9d896d-39fb-45c5-a0fe-d4056feb8258 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034188 Aug 27 02:29:03.922126 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 514/1048] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Aug 27 02:29:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:29:04.339154 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-414e0b6d-f187-4bf4-8e17-10858186ea6d tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:04.341375 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-414e0b6d-f187-4bf4-8e17-10858186ea6d tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] [instance: b94a90e1-180f-4f18-bad5-f4ecfbce94b2] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:04.348706 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-414e0b6d-f187-4bf4-8e17-10858186ea6d tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:04.349293 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-414e0b6d-f187-4bf4-8e17-10858186ea6d tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:04.349827 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-414e0b6d-f187-4bf4-8e17-10858186ea6d tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:04.350584 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-414e0b6d-f187-4bf4-8e17-10858186ea6d tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:04.351902 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-414e0b6d-f187-4bf4-8e17-10858186ea6d tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:04.352406 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-414e0b6d-f187-4bf4-8e17-10858186ea6d tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:04.387258 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-414e0b6d-f187-4bf4-8e17-10858186ea6d tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:04.387801 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-414e0b6d-f187-4bf4-8e17-10858186ea6d tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:04.388386 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-414e0b6d-f187-4bf4-8e17-10858186ea6d tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:04.388730 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.objects.instance [None req-414e0b6d-f187-4bf4-8e17-10858186ea6d tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lazy-loading 'fault' on Instance uuid b94a90e1-180f-4f18-bad5-f4ecfbce94b2 {{(pid=120782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:29:04.436581 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-414e0b6d-f187-4bf4-8e17-10858186ea6d tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fab0689ace84088890202583f75dc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48950f3d194a467e81bc74adfca6d94f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:04.446500 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-414e0b6d-f187-4bf4-8e17-10858186ea6d tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] 10.222.0.61 "GET /compute/v2.1/servers/b94a90e1-180f-4f18-bad5-f4ecfbce94b2" status: 200 len: 1304 microversion: 2.1 time: 0.111199 Aug 27 02:29:04.447342 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 535/1049] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:29:04 2022] GET /compute/v2.1/servers/b94a90e1-180f-4f18-bad5-f4ecfbce94b2 => generated 1304 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:29:05.469372 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-3a9c2dae-f76d-4fbf-b527-77e98f6c20f7 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:05.470079 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-3a9c2dae-f76d-4fbf-b527-77e98f6c20f7 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] [instance: b94a90e1-180f-4f18-bad5-f4ecfbce94b2] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:05.477464 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3a9c2dae-f76d-4fbf-b527-77e98f6c20f7 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:05.477781 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3a9c2dae-f76d-4fbf-b527-77e98f6c20f7 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:05.478229 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3a9c2dae-f76d-4fbf-b527-77e98f6c20f7 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:05.478916 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3a9c2dae-f76d-4fbf-b527-77e98f6c20f7 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:05.479359 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3a9c2dae-f76d-4fbf-b527-77e98f6c20f7 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:05.479777 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3a9c2dae-f76d-4fbf-b527-77e98f6c20f7 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:05.494260 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.wsgi [None req-3a9c2dae-f76d-4fbf-b527-77e98f6c20f7 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] HTTP exception thrown: Instance b94a90e1-180f-4f18-bad5-f4ecfbce94b2 could not be found. Aug 27 02:29:05.495892 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-3a9c2dae-f76d-4fbf-b527-77e98f6c20f7 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Request method failure captured: Aug 27 02:29:05.495892 dv-cinder-846303-3-smb devstack@n-api.service[120783]: request: GET /compute/v2.1/servers/b94a90e1-180f-4f18-bad5-f4ecfbce94b2 HTTP/1.1 Aug 27 02:29:05.495892 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Accept: application/json Aug 27 02:29:05.495892 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Accept-Encoding: identity Aug 27 02:29:05.495892 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Connection: close Aug 27 02:29:05.495892 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Content-Length: 0 Aug 27 02:29:05.495892 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Content-Type: application/json Aug 27 02:29:05.495892 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Host: 10.222.0.61 Aug 27 02:29:05.495892 dv-cinder-846303-3-smb devstack@n-api.service[120783]: Openstack-System-Scope: None Aug 27 02:29:05.495892 dv-cinder-846303-3-smb devstack@n-api.service[120783]: User-Agent: python-urllib3/1.26.11 Aug 27 02:29:05.495892 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Auth-Token: gAAAAABjCYFc5mw_FDt2fvFQm9v8i_RU4eUz5SDH1Du1XUo8Vf0iyFEZPuPAdg4Cix74DUbNPCbDqQ517_1JXe7LUBI9Qz3i-NUlG2LIk6BXuYaIq5y_-UG1Cu7dpk8bN4leBNvAFZdi_IZKc6v5ehxvm4zKCPupxYYOegs-ELIzEklDdhH-PL8 Aug 27 02:29:05.495892 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Domain-Id: None Aug 27 02:29:05.495892 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Domain-Name: None Aug 27 02:29:05.495892 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Identity-Status: Confirmed Aug 27 02:29:05.495892 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Is-Admin-Project: True Aug 27 02:29:05.495892 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Project-Domain-Id: default Aug 27 02:29:05.495892 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Project-Domain-Name: Default Aug 27 02:29:05.495892 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Project-Id: 48950f3d194a467e81bc74adfca6d94f Aug 27 02:29:05.495892 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Project-Name: tempest-VolumesActionsTest-728668484 Aug 27 02:29:05.495892 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Role: member,reader Aug 27 02:29:05.495892 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Roles: member,reader Aug 27 02:29:05.497961 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/48950f3d194a467e81bc74adfca6d94f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_48950f3d194a467e81bc74adfca6d94f", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/48950f3d194a467e81bc74adfca6d94f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/48950f3d194a467e81bc74adfca6d94f"}]}] Aug 27 02:29:05.497961 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Tenant: tempest-VolumesActionsTest-728668484 Aug 27 02:29:05.497961 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Tenant-Id: 48950f3d194a467e81bc74adfca6d94f Aug 27 02:29:05.497961 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-Tenant-Name: tempest-VolumesActionsTest-728668484 Aug 27 02:29:05.497961 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User: tempest-VolumesActionsTest-728668484-project Aug 27 02:29:05.497961 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User-Domain-Id: default Aug 27 02:29:05.497961 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User-Domain-Name: Default Aug 27 02:29:05.497961 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User-Id: 6fab0689ace84088890202583f75dc3e Aug 27 02:29:05.497961 dv-cinder-846303-3-smb devstack@n-api.service[120783]: X-User-Name: tempest-VolumesActionsTest-728668484-project Aug 27 02:29:05.497961 dv-cinder-846303-3-smb devstack@n-api.service[120783]: method: > Aug 27 02:29:05.497961 dv-cinder-846303-3-smb devstack@n-api.service[120783]: exception: Instance b94a90e1-180f-4f18-bad5-f4ecfbce94b2 could not be found. Aug 27 02:29:05.497961 dv-cinder-846303-3-smb devstack@n-api.service[120783]: action_args: {'id': 'b94a90e1-180f-4f18-bad5-f4ecfbce94b2'} Aug 27 02:29:05.499059 dv-cinder-846303-3-smb devstack@n-api.service[120783]: {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:29:05.499059 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:29:05.499059 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:29:05.499059 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:29:05.499059 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:29:05.499059 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:29:05.499059 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:29:05.499059 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:29:05.499059 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:29:05.499059 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:29:05.499059 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b94a90e1-180f-4f18-bad5-f4ecfbce94b2 could not be found. Aug 27 02:29:05.499059 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:29:05.499059 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:29:05.499059 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:29:05.499059 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:29:05.499059 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:29:05.499059 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:29:05.499059 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:29:05.499059 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:29:05.499059 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:29:05.500634 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:29:05.500634 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:29:05.500634 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:29:05.500634 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:29:05.500634 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:29:05.500634 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:29:05.500634 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:29:05.500634 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b94a90e1-180f-4f18-bad5-f4ecfbce94b2 could not be found. Aug 27 02:29:05.500634 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:29:05.500634 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:29:05.500634 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:29:05.500634 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:29:05.500634 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:29:05.500634 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:29:05.500634 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:29:05.500634 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:29:05.500634 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b94a90e1-180f-4f18-bad5-f4ecfbce94b2 could not be found. Aug 27 02:29:05.500634 dv-cinder-846303-3-smb devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Aug 27 02:29:05.502203 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-3a9c2dae-f76d-4fbf-b527-77e98f6c20f7 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Returning 404 to user: Instance b94a90e1-180f-4f18-bad5-f4ecfbce94b2 could not be found. {{(pid=120783) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:29:05.502203 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-3a9c2dae-f76d-4fbf-b527-77e98f6c20f7 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] 10.222.0.61 "GET /compute/v2.1/servers/b94a90e1-180f-4f18-bad5-f4ecfbce94b2" status: 404 len: 111 microversion: 2.1 time: 0.032224 Aug 27 02:29:05.502203 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 515/1050] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:29:05 2022] GET /compute/v2.1/servers/b94a90e1-180f-4f18-bad5-f4ecfbce94b2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:29:05.610521 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-934e171b-fef3-46c4-8fdb-cd96fdf13d87 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1975584797", "imageRef": "7d45cdd6-750f-40c7-9475-f7bf12fcb204", "flavorRef": "452", "networks": [{"uuid": "bb27b2c3-6005-4f6b-968f-fdc7e91bdeda"}]}} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:29:05.669740 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.network.neutron [None req-934e171b-fef3-46c4-8fdb-cd96fdf13d87 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] validate_networks() for [('bb27b2c3-6005-4f6b-968f-fdc7e91bdeda', None, None, None, None, None)] {{(pid=120782) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:29:06.029828 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-934e171b-fef3-46c4-8fdb-cd96fdf13d87 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Flavor limits 0:0:0 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:29:06.030248 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-934e171b-fef3-46c4-8fdb-cd96fdf13d87 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Image limits 0:0:0 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:29:06.030720 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-934e171b-fef3-46c4-8fdb-cd96fdf13d87 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Flavor pref 0:0:0 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:29:06.031125 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-934e171b-fef3-46c4-8fdb-cd96fdf13d87 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Image pref 0:0:0 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:29:06.031585 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-934e171b-fef3-46c4-8fdb-cd96fdf13d87 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:29:06.041015 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-934e171b-fef3-46c4-8fdb-cd96fdf13d87 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:06.041532 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-934e171b-fef3-46c4-8fdb-cd96fdf13d87 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:06.041976 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-934e171b-fef3-46c4-8fdb-cd96fdf13d87 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:06.042697 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-934e171b-fef3-46c4-8fdb-cd96fdf13d87 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:06.043149 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-934e171b-fef3-46c4-8fdb-cd96fdf13d87 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:06.043581 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-934e171b-fef3-46c4-8fdb-cd96fdf13d87 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:06.061485 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.quota [None req-934e171b-fef3-46c4-8fdb-cd96fdf13d87 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Getting quotas for project 48950f3d194a467e81bc74adfca6d94f. Resources: {'instances', 'ram', 'cores'} {{(pid=120782) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:29:06.065757 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.quota [None req-934e171b-fef3-46c4-8fdb-cd96fdf13d87 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Getting quotas for user 6fab0689ace84088890202583f75dc3e and project 48950f3d194a467e81bc74adfca6d94f. Resources: {'instances', 'ram', 'cores'} {{(pid=120782) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:29:06.077723 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-934e171b-fef3-46c4-8fdb-cd96fdf13d87 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Going to run 1 instances... {{(pid=120782) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:29:06.080132 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-934e171b-fef3-46c4-8fdb-cd96fdf13d87 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] [instance: 90b9d290-1aca-4de5-bc22-15f34579c8d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7d45cdd6-750f-40c7-9475-f7bf12fcb204',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120782) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:29:06.130122 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-934e171b-fef3-46c4-8fdb-cd96fdf13d87 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.525456 Aug 27 02:29:06.130844 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 536/1051] 10.222.0.61 () {60 vars in 1147 bytes} [Sat Aug 27 02:29:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 527 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 02:29:06.142789 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-29bbd159-9bb7-4bce-9106-980d887e6de4 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:06.143537 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-29bbd159-9bb7-4bce-9106-980d887e6de4 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] [instance: 90b9d290-1aca-4de5-bc22-15f34579c8d0] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:06.200203 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-29bbd159-9bb7-4bce-9106-980d887e6de4 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fab0689ace84088890202583f75dc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48950f3d194a467e81bc74adfca6d94f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:06.207586 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-29bbd159-9bb7-4bce-9106-980d887e6de4 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] 10.222.0.61 "GET /compute/v2.1/servers/90b9d290-1aca-4de5-bc22-15f34579c8d0" status: 200 len: 1214 microversion: 2.1 time: 0.069297 Aug 27 02:29:06.208437 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 516/1052] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:29:06 2022] GET /compute/v2.1/servers/90b9d290-1aca-4de5-bc22-15f34579c8d0 => generated 1214 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:29:07.228556 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-44905a15-91bd-41ca-890e-f107748250f0 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:07.229973 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-44905a15-91bd-41ca-890e-f107748250f0 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] [instance: 90b9d290-1aca-4de5-bc22-15f34579c8d0] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:07.238178 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-44905a15-91bd-41ca-890e-f107748250f0 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:07.238711 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-44905a15-91bd-41ca-890e-f107748250f0 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:07.239138 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-44905a15-91bd-41ca-890e-f107748250f0 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:07.239837 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-44905a15-91bd-41ca-890e-f107748250f0 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:07.240452 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-44905a15-91bd-41ca-890e-f107748250f0 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:07.241031 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-44905a15-91bd-41ca-890e-f107748250f0 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:07.360726 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-44905a15-91bd-41ca-890e-f107748250f0 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fab0689ace84088890202583f75dc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48950f3d194a467e81bc74adfca6d94f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:07.366091 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-44905a15-91bd-41ca-890e-f107748250f0 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] 10.222.0.61 "GET /compute/v2.1/servers/90b9d290-1aca-4de5-bc22-15f34579c8d0" status: 200 len: 1284 microversion: 2.1 time: 0.141722 Aug 27 02:29:07.366775 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 537/1053] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:29:07 2022] GET /compute/v2.1/servers/90b9d290-1aca-4de5-bc22-15f34579c8d0 => generated 1284 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:29:08.387843 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-9f8d3973-815a-491b-9573-3452f8c9883b tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:08.388741 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-9f8d3973-815a-491b-9573-3452f8c9883b tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] [instance: 90b9d290-1aca-4de5-bc22-15f34579c8d0] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:08.398958 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9f8d3973-815a-491b-9573-3452f8c9883b tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:08.399688 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9f8d3973-815a-491b-9573-3452f8c9883b tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:08.400126 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9f8d3973-815a-491b-9573-3452f8c9883b tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:08.400842 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9f8d3973-815a-491b-9573-3452f8c9883b tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:08.401281 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9f8d3973-815a-491b-9573-3452f8c9883b tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:08.401731 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9f8d3973-815a-491b-9573-3452f8c9883b tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:08.570731 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [req-58d8343d-fe29-4595-a5ce-e6fd25b8a211 req-6f7c5cdd-3fcd-48d3-8d5f-4ecda20acec8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90b9d290-1aca-4de5-bc22-15f34579c8d0", "tag": "9c439abe-fb0b-4a39-b46e-c2c53b32f60a"}]} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:29:08.574351 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-9f8d3973-815a-491b-9573-3452f8c9883b tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fab0689ace84088890202583f75dc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48950f3d194a467e81bc74adfca6d94f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:08.592166 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-58d8343d-fe29-4595-a5ce-e6fd25b8a211 req-6f7c5cdd-3fcd-48d3-8d5f-4ecda20acec8 service nova] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:08.592646 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-58d8343d-fe29-4595-a5ce-e6fd25b8a211 req-6f7c5cdd-3fcd-48d3-8d5f-4ecda20acec8 service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:08.593075 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-58d8343d-fe29-4595-a5ce-e6fd25b8a211 req-6f7c5cdd-3fcd-48d3-8d5f-4ecda20acec8 service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:08.605020 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.compute.server_external_events [req-58d8343d-fe29-4595-a5ce-e6fd25b8a211 req-6f7c5cdd-3fcd-48d3-8d5f-4ecda20acec8 service nova] Creating event network-changed:9c439abe-fb0b-4a39-b46e-c2c53b32f60a for instance 90b9d290-1aca-4de5-bc22-15f34579c8d0 on hv-cinder-84630 Aug 27 02:29:08.610631 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [req-58d8343d-fe29-4595-a5ce-e6fd25b8a211 req-6f7c5cdd-3fcd-48d3-8d5f-4ecda20acec8 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052406 Aug 27 02:29:08.611235 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 538/1054] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Aug 27 02:29:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:29:08.616385 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-9f8d3973-815a-491b-9573-3452f8c9883b tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] 10.222.0.61 "GET /compute/v2.1/servers/90b9d290-1aca-4de5-bc22-15f34579c8d0" status: 200 len: 1314 microversion: 2.1 time: 0.232074 Aug 27 02:29:08.617500 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 517/1055] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:29:08 2022] GET /compute/v2.1/servers/90b9d290-1aca-4de5-bc22-15f34579c8d0 => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:29:09.640136 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-719a2a72-5cc8-4700-8504-726fad539db9 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:09.640873 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-719a2a72-5cc8-4700-8504-726fad539db9 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] [instance: 90b9d290-1aca-4de5-bc22-15f34579c8d0] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:09.648285 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-719a2a72-5cc8-4700-8504-726fad539db9 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:09.648812 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-719a2a72-5cc8-4700-8504-726fad539db9 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:09.649248 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-719a2a72-5cc8-4700-8504-726fad539db9 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:09.650033 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-719a2a72-5cc8-4700-8504-726fad539db9 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:09.650492 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-719a2a72-5cc8-4700-8504-726fad539db9 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:09.650976 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-719a2a72-5cc8-4700-8504-726fad539db9 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:09.875564 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-719a2a72-5cc8-4700-8504-726fad539db9 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fab0689ace84088890202583f75dc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48950f3d194a467e81bc74adfca6d94f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:09.883618 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-719a2a72-5cc8-4700-8504-726fad539db9 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] 10.222.0.61 "GET /compute/v2.1/servers/90b9d290-1aca-4de5-bc22-15f34579c8d0" status: 200 len: 1314 microversion: 2.1 time: 0.248939 Aug 27 02:29:09.884324 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 539/1056] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:29:09 2022] GET /compute/v2.1/servers/90b9d290-1aca-4de5-bc22-15f34579c8d0 => generated 1314 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:29:10.905661 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-807762ed-b2f7-4833-b5db-ee19f96aba05 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:10.906388 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-807762ed-b2f7-4833-b5db-ee19f96aba05 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] [instance: 90b9d290-1aca-4de5-bc22-15f34579c8d0] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:10.913086 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-807762ed-b2f7-4833-b5db-ee19f96aba05 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:10.913695 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-807762ed-b2f7-4833-b5db-ee19f96aba05 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:10.914131 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-807762ed-b2f7-4833-b5db-ee19f96aba05 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:10.914828 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-807762ed-b2f7-4833-b5db-ee19f96aba05 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:10.915285 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-807762ed-b2f7-4833-b5db-ee19f96aba05 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:10.915710 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-807762ed-b2f7-4833-b5db-ee19f96aba05 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:11.067585 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-807762ed-b2f7-4833-b5db-ee19f96aba05 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fab0689ace84088890202583f75dc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48950f3d194a467e81bc74adfca6d94f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:11.075945 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-807762ed-b2f7-4833-b5db-ee19f96aba05 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] 10.222.0.61 "GET /compute/v2.1/servers/90b9d290-1aca-4de5-bc22-15f34579c8d0" status: 200 len: 1314 microversion: 2.1 time: 0.174180 Aug 27 02:29:11.076532 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 518/1057] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:29:10 2022] GET /compute/v2.1/servers/90b9d290-1aca-4de5-bc22-15f34579c8d0 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:29:12.096372 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-6c3951ce-814d-4239-838c-e82f7cff89bf tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:12.096961 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-6c3951ce-814d-4239-838c-e82f7cff89bf tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] [instance: 90b9d290-1aca-4de5-bc22-15f34579c8d0] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:12.104425 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6c3951ce-814d-4239-838c-e82f7cff89bf tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:12.104918 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6c3951ce-814d-4239-838c-e82f7cff89bf tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:12.105358 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6c3951ce-814d-4239-838c-e82f7cff89bf tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:12.106088 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6c3951ce-814d-4239-838c-e82f7cff89bf tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:12.106545 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6c3951ce-814d-4239-838c-e82f7cff89bf tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:12.106960 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6c3951ce-814d-4239-838c-e82f7cff89bf tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:12.237487 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-6c3951ce-814d-4239-838c-e82f7cff89bf tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fab0689ace84088890202583f75dc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48950f3d194a467e81bc74adfca6d94f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:12.245646 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-6c3951ce-814d-4239-838c-e82f7cff89bf tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] 10.222.0.61 "GET /compute/v2.1/servers/90b9d290-1aca-4de5-bc22-15f34579c8d0" status: 200 len: 1314 microversion: 2.1 time: 0.153175 Aug 27 02:29:12.246235 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 540/1058] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:29:12 2022] GET /compute/v2.1/servers/90b9d290-1aca-4de5-bc22-15f34579c8d0 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:29:13.267098 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-0bf0fa9d-6caf-4584-b457-6aa47dbfeda2 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:13.267721 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-0bf0fa9d-6caf-4584-b457-6aa47dbfeda2 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] [instance: 90b9d290-1aca-4de5-bc22-15f34579c8d0] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:13.274617 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0bf0fa9d-6caf-4584-b457-6aa47dbfeda2 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:13.275103 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0bf0fa9d-6caf-4584-b457-6aa47dbfeda2 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:13.275539 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0bf0fa9d-6caf-4584-b457-6aa47dbfeda2 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:13.276229 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0bf0fa9d-6caf-4584-b457-6aa47dbfeda2 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:13.276683 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0bf0fa9d-6caf-4584-b457-6aa47dbfeda2 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:13.277104 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0bf0fa9d-6caf-4584-b457-6aa47dbfeda2 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:13.295354 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:29:13.410076 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-0bf0fa9d-6caf-4584-b457-6aa47dbfeda2 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fab0689ace84088890202583f75dc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48950f3d194a467e81bc74adfca6d94f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:13.417874 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-0bf0fa9d-6caf-4584-b457-6aa47dbfeda2 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] 10.222.0.61 "GET /compute/v2.1/servers/90b9d290-1aca-4de5-bc22-15f34579c8d0" status: 200 len: 1314 microversion: 2.1 time: 0.155002 Aug 27 02:29:13.418465 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 519/1059] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:29:13 2022] GET /compute/v2.1/servers/90b9d290-1aca-4de5-bc22-15f34579c8d0 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:29:14.099239 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [req-d0934aef-f03b-43cf-a4fd-fa43781b94c5 req-fd426f63-943d-4beb-88aa-d8bb19056e12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90b9d290-1aca-4de5-bc22-15f34579c8d0", "name": "network-vif-plugged", "status": "completed", "tag": "9c439abe-fb0b-4a39-b46e-c2c53b32f60a"}]} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:29:14.109439 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-d0934aef-f03b-43cf-a4fd-fa43781b94c5 req-fd426f63-943d-4beb-88aa-d8bb19056e12 service nova] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:14.109959 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-d0934aef-f03b-43cf-a4fd-fa43781b94c5 req-fd426f63-943d-4beb-88aa-d8bb19056e12 service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:14.110390 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-d0934aef-f03b-43cf-a4fd-fa43781b94c5 req-fd426f63-943d-4beb-88aa-d8bb19056e12 service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:14.122334 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.compute.server_external_events [req-d0934aef-f03b-43cf-a4fd-fa43781b94c5 req-fd426f63-943d-4beb-88aa-d8bb19056e12 service nova] Creating event network-vif-plugged:9c439abe-fb0b-4a39-b46e-c2c53b32f60a for instance 90b9d290-1aca-4de5-bc22-15f34579c8d0 on hv-cinder-84630 Aug 27 02:29:14.127497 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [req-d0934aef-f03b-43cf-a4fd-fa43781b94c5 req-fd426f63-943d-4beb-88aa-d8bb19056e12 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031943 Aug 27 02:29:14.128084 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 541/1060] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Aug 27 02:29:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:29:14.438926 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-1dfacebf-8154-4dd7-a856-cf2edb2f8dd8 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:14.439529 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-1dfacebf-8154-4dd7-a856-cf2edb2f8dd8 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] [instance: 90b9d290-1aca-4de5-bc22-15f34579c8d0] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:14.446729 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1dfacebf-8154-4dd7-a856-cf2edb2f8dd8 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:14.447207 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1dfacebf-8154-4dd7-a856-cf2edb2f8dd8 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:14.447633 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1dfacebf-8154-4dd7-a856-cf2edb2f8dd8 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:14.448319 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1dfacebf-8154-4dd7-a856-cf2edb2f8dd8 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:14.448789 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1dfacebf-8154-4dd7-a856-cf2edb2f8dd8 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:14.449158 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1dfacebf-8154-4dd7-a856-cf2edb2f8dd8 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:14.584277 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-1dfacebf-8154-4dd7-a856-cf2edb2f8dd8 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fab0689ace84088890202583f75dc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48950f3d194a467e81bc74adfca6d94f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:14.592432 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-1dfacebf-8154-4dd7-a856-cf2edb2f8dd8 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] 10.222.0.61 "GET /compute/v2.1/servers/90b9d290-1aca-4de5-bc22-15f34579c8d0" status: 200 len: 1314 microversion: 2.1 time: 0.157504 Aug 27 02:29:14.593007 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 520/1061] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:29:14 2022] GET /compute/v2.1/servers/90b9d290-1aca-4de5-bc22-15f34579c8d0 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:29:15.614442 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-3f6d0777-2fb8-40af-9436-db6979507e98 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:15.615134 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-3f6d0777-2fb8-40af-9436-db6979507e98 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] [instance: 90b9d290-1aca-4de5-bc22-15f34579c8d0] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:15.625297 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3f6d0777-2fb8-40af-9436-db6979507e98 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:15.625868 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3f6d0777-2fb8-40af-9436-db6979507e98 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:15.626304 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3f6d0777-2fb8-40af-9436-db6979507e98 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:15.627003 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3f6d0777-2fb8-40af-9436-db6979507e98 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:15.627453 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3f6d0777-2fb8-40af-9436-db6979507e98 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:15.627875 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3f6d0777-2fb8-40af-9436-db6979507e98 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:15.763270 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-3f6d0777-2fb8-40af-9436-db6979507e98 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fab0689ace84088890202583f75dc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48950f3d194a467e81bc74adfca6d94f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:15.771998 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-3f6d0777-2fb8-40af-9436-db6979507e98 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] 10.222.0.61 "GET /compute/v2.1/servers/90b9d290-1aca-4de5-bc22-15f34579c8d0" status: 200 len: 1497 microversion: 2.1 time: 0.162477 Aug 27 02:29:15.772562 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 542/1062] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:29:15 2022] GET /compute/v2.1/servers/90b9d290-1aca-4de5-bc22-15f34579c8d0 => generated 1497 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:29:16.259283 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-6d764ad8-58d5-4d9d-b14c-2d29264b6d81 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:16.259833 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-6d764ad8-58d5-4d9d-b14c-2d29264b6d81 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] [instance: 90b9d290-1aca-4de5-bc22-15f34579c8d0] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:16.262235 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell0:SELECT=2 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:29:16.267850 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6d764ad8-58d5-4d9d-b14c-2d29264b6d81 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:16.268339 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6d764ad8-58d5-4d9d-b14c-2d29264b6d81 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:16.268769 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6d764ad8-58d5-4d9d-b14c-2d29264b6d81 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:16.269477 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6d764ad8-58d5-4d9d-b14c-2d29264b6d81 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:16.269953 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6d764ad8-58d5-4d9d-b14c-2d29264b6d81 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:16.270378 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6d764ad8-58d5-4d9d-b14c-2d29264b6d81 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:16.298563 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-6d764ad8-58d5-4d9d-b14c-2d29264b6d81 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] [instance: 90b9d290-1aca-4de5-bc22-15f34579c8d0] Going to try to terminate instance {{(pid=120783) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:29:16.380099 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-6d764ad8-58d5-4d9d-b14c-2d29264b6d81 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] 10.222.0.61 "DELETE /compute/v2.1/servers/90b9d290-1aca-4de5-bc22-15f34579c8d0" status: 204 len: 0 microversion: 2.1 time: 0.124420 Aug 27 02:29:16.380986 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 521/1063] 10.222.0.61 () {58 vars in 1239 bytes} [Sat Aug 27 02:29:16 2022] DELETE /compute/v2.1/servers/90b9d290-1aca-4de5-bc22-15f34579c8d0 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:29:16.391923 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-44125948-0fe5-49b2-be39-1a7d17c2b86b tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:16.393649 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-44125948-0fe5-49b2-be39-1a7d17c2b86b tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] [instance: 90b9d290-1aca-4de5-bc22-15f34579c8d0] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:16.394879 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell0:SELECT=2 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:29:16.395532 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell0:SELECT=6 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:29:16.396252 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=6,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:29:16.402688 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-44125948-0fe5-49b2-be39-1a7d17c2b86b tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:16.403373 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-44125948-0fe5-49b2-be39-1a7d17c2b86b tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:16.403803 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-44125948-0fe5-49b2-be39-1a7d17c2b86b tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:16.404496 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-44125948-0fe5-49b2-be39-1a7d17c2b86b tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:16.404938 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-44125948-0fe5-49b2-be39-1a7d17c2b86b tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:16.405627 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-44125948-0fe5-49b2-be39-1a7d17c2b86b tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:16.410705 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:29:16.556269 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.policy [None req-44125948-0fe5-49b2-be39-1a7d17c2b86b tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fab0689ace84088890202583f75dc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48950f3d194a467e81bc74adfca6d94f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:16.565699 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-44125948-0fe5-49b2-be39-1a7d17c2b86b tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] 10.222.0.61 "GET /compute/v2.1/servers/90b9d290-1aca-4de5-bc22-15f34579c8d0" status: 200 len: 1503 microversion: 2.1 time: 0.179610 Aug 27 02:29:16.566608 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 543/1064] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:29:16 2022] GET /compute/v2.1/servers/90b9d290-1aca-4de5-bc22-15f34579c8d0 => generated 1503 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:29:17.589235 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-42d0b023-987d-414b-96aa-62c5aca06a28 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:17.589979 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-42d0b023-987d-414b-96aa-62c5aca06a28 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] [instance: 90b9d290-1aca-4de5-bc22-15f34579c8d0] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:17.592394 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=2 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:29:17.597950 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-42d0b023-987d-414b-96aa-62c5aca06a28 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:17.598442 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-42d0b023-987d-414b-96aa-62c5aca06a28 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:17.598882 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-42d0b023-987d-414b-96aa-62c5aca06a28 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:17.599589 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-42d0b023-987d-414b-96aa-62c5aca06a28 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:17.600046 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-42d0b023-987d-414b-96aa-62c5aca06a28 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:17.600470 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-42d0b023-987d-414b-96aa-62c5aca06a28 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:17.753997 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-42d0b023-987d-414b-96aa-62c5aca06a28 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fab0689ace84088890202583f75dc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48950f3d194a467e81bc74adfca6d94f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:17.763942 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-42d0b023-987d-414b-96aa-62c5aca06a28 tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] 10.222.0.61 "GET /compute/v2.1/servers/90b9d290-1aca-4de5-bc22-15f34579c8d0" status: 200 len: 1503 microversion: 2.1 time: 0.179425 Aug 27 02:29:17.765065 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 522/1065] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:29:17 2022] GET /compute/v2.1/servers/90b9d290-1aca-4de5-bc22-15f34579c8d0 => generated 1503 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:29:18.364697 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [req-b8108895-123a-45b9-8ae6-7c7e42dbe13a req-1d0fd66a-4472-4ae1-ae66-a3679b5a554b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90b9d290-1aca-4de5-bc22-15f34579c8d0", "name": "network-vif-deleted", "tag": "9c439abe-fb0b-4a39-b46e-c2c53b32f60a"}]} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:29:18.375087 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-b8108895-123a-45b9-8ae6-7c7e42dbe13a req-1d0fd66a-4472-4ae1-ae66-a3679b5a554b service nova] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:18.375577 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-b8108895-123a-45b9-8ae6-7c7e42dbe13a req-1d0fd66a-4472-4ae1-ae66-a3679b5a554b service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:18.376001 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-b8108895-123a-45b9-8ae6-7c7e42dbe13a req-1d0fd66a-4472-4ae1-ae66-a3679b5a554b service nova] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:18.403161 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.compute.server_external_events [req-b8108895-123a-45b9-8ae6-7c7e42dbe13a req-1d0fd66a-4472-4ae1-ae66-a3679b5a554b service nova] Creating event network-vif-deleted:9c439abe-fb0b-4a39-b46e-c2c53b32f60a for instance 90b9d290-1aca-4de5-bc22-15f34579c8d0 on hv-cinder-84630 Aug 27 02:29:18.409359 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [req-b8108895-123a-45b9-8ae6-7c7e42dbe13a req-1d0fd66a-4472-4ae1-ae66-a3679b5a554b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049973 Aug 27 02:29:18.410148 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 544/1066] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Aug 27 02:29:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:29:18.791454 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-1a1a71f1-6360-45cf-8440-af4a0d1edf0c tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:18.792022 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-1a1a71f1-6360-45cf-8440-af4a0d1edf0c tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] [instance: 90b9d290-1aca-4de5-bc22-15f34579c8d0] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:18.799410 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1a1a71f1-6360-45cf-8440-af4a0d1edf0c tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:18.799925 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1a1a71f1-6360-45cf-8440-af4a0d1edf0c tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:18.800385 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1a1a71f1-6360-45cf-8440-af4a0d1edf0c tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:18.801103 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1a1a71f1-6360-45cf-8440-af4a0d1edf0c tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:18.801590 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1a1a71f1-6360-45cf-8440-af4a0d1edf0c tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:18.802037 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1a1a71f1-6360-45cf-8440-af4a0d1edf0c tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:18.848125 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1a1a71f1-6360-45cf-8440-af4a0d1edf0c tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:18.848941 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1a1a71f1-6360-45cf-8440-af4a0d1edf0c tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:18.849949 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1a1a71f1-6360-45cf-8440-af4a0d1edf0c tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:18.850725 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.objects.instance [None req-1a1a71f1-6360-45cf-8440-af4a0d1edf0c tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lazy-loading 'fault' on Instance uuid 90b9d290-1aca-4de5-bc22-15f34579c8d0 {{(pid=120783) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:29:18.894717 dv-cinder-846303-3-smb devstack@n-api.service[120783]: DEBUG nova.policy [None req-1a1a71f1-6360-45cf-8440-af4a0d1edf0c tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fab0689ace84088890202583f75dc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48950f3d194a467e81bc74adfca6d94f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:18.903470 dv-cinder-846303-3-smb devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-1a1a71f1-6360-45cf-8440-af4a0d1edf0c tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] 10.222.0.61 "GET /compute/v2.1/servers/90b9d290-1aca-4de5-bc22-15f34579c8d0" status: 200 len: 1304 microversion: 2.1 time: 0.116190 Aug 27 02:29:18.904154 dv-cinder-846303-3-smb devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 523/1067] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:29:18 2022] GET /compute/v2.1/servers/90b9d290-1aca-4de5-bc22-15f34579c8d0 => generated 1304 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:29:19.928088 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-23926403-a429-45dc-8408-f270e001788d tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:19.929004 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-23926403-a429-45dc-8408-f270e001788d tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] [instance: 90b9d290-1aca-4de5-bc22-15f34579c8d0] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:19.935885 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-23926403-a429-45dc-8408-f270e001788d tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:19.936370 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-23926403-a429-45dc-8408-f270e001788d tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:19.936802 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-23926403-a429-45dc-8408-f270e001788d tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:19.937535 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-23926403-a429-45dc-8408-f270e001788d tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Acquiring lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:19.938109 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-23926403-a429-45dc-8408-f270e001788d tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:19.938535 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-23926403-a429-45dc-8408-f270e001788d tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Lock "fd1fc341-d010-4ff9-88d0-44b72da91d5f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:19.953046 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.wsgi [None req-23926403-a429-45dc-8408-f270e001788d tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] HTTP exception thrown: Instance 90b9d290-1aca-4de5-bc22-15f34579c8d0 could not be found. Aug 27 02:29:19.954763 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-23926403-a429-45dc-8408-f270e001788d tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Request method failure captured: Aug 27 02:29:19.954763 dv-cinder-846303-3-smb devstack@n-api.service[120782]: request: GET /compute/v2.1/servers/90b9d290-1aca-4de5-bc22-15f34579c8d0 HTTP/1.1 Aug 27 02:29:19.954763 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Accept: application/json Aug 27 02:29:19.954763 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Accept-Encoding: identity Aug 27 02:29:19.954763 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Connection: close Aug 27 02:29:19.954763 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Content-Length: 0 Aug 27 02:29:19.954763 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Content-Type: application/json Aug 27 02:29:19.954763 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Host: 10.222.0.61 Aug 27 02:29:19.954763 dv-cinder-846303-3-smb devstack@n-api.service[120782]: Openstack-System-Scope: None Aug 27 02:29:19.954763 dv-cinder-846303-3-smb devstack@n-api.service[120782]: User-Agent: python-urllib3/1.26.11 Aug 27 02:29:19.954763 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Auth-Token: gAAAAABjCYFc5mw_FDt2fvFQm9v8i_RU4eUz5SDH1Du1XUo8Vf0iyFEZPuPAdg4Cix74DUbNPCbDqQ517_1JXe7LUBI9Qz3i-NUlG2LIk6BXuYaIq5y_-UG1Cu7dpk8bN4leBNvAFZdi_IZKc6v5ehxvm4zKCPupxYYOegs-ELIzEklDdhH-PL8 Aug 27 02:29:19.954763 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Domain-Id: None Aug 27 02:29:19.954763 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Domain-Name: None Aug 27 02:29:19.954763 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Identity-Status: Confirmed Aug 27 02:29:19.954763 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Is-Admin-Project: True Aug 27 02:29:19.954763 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Domain-Id: default Aug 27 02:29:19.954763 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Domain-Name: Default Aug 27 02:29:19.954763 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Id: 48950f3d194a467e81bc74adfca6d94f Aug 27 02:29:19.954763 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Project-Name: tempest-VolumesActionsTest-728668484 Aug 27 02:29:19.954763 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Role: member,reader Aug 27 02:29:19.954763 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Roles: member,reader Aug 27 02:29:19.956240 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/48950f3d194a467e81bc74adfca6d94f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_48950f3d194a467e81bc74adfca6d94f", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/48950f3d194a467e81bc74adfca6d94f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/48950f3d194a467e81bc74adfca6d94f"}]}] Aug 27 02:29:19.956240 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Tenant: tempest-VolumesActionsTest-728668484 Aug 27 02:29:19.956240 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Tenant-Id: 48950f3d194a467e81bc74adfca6d94f Aug 27 02:29:19.956240 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-Tenant-Name: tempest-VolumesActionsTest-728668484 Aug 27 02:29:19.956240 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User: tempest-VolumesActionsTest-728668484-project Aug 27 02:29:19.956240 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Domain-Id: default Aug 27 02:29:19.956240 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Domain-Name: Default Aug 27 02:29:19.956240 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Id: 6fab0689ace84088890202583f75dc3e Aug 27 02:29:19.956240 dv-cinder-846303-3-smb devstack@n-api.service[120782]: X-User-Name: tempest-VolumesActionsTest-728668484-project Aug 27 02:29:19.956240 dv-cinder-846303-3-smb devstack@n-api.service[120782]: method: > Aug 27 02:29:19.956240 dv-cinder-846303-3-smb devstack@n-api.service[120782]: exception: Instance 90b9d290-1aca-4de5-bc22-15f34579c8d0 could not be found. Aug 27 02:29:19.956240 dv-cinder-846303-3-smb devstack@n-api.service[120782]: action_args: {'id': '90b9d290-1aca-4de5-bc22-15f34579c8d0'} Aug 27 02:29:19.956995 dv-cinder-846303-3-smb devstack@n-api.service[120782]: {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:29:19.956995 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:29:19.956995 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:29:19.956995 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:29:19.956995 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:29:19.956995 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:29:19.956995 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:29:19.956995 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:29:19.956995 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:29:19.956995 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:29:19.956995 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90b9d290-1aca-4de5-bc22-15f34579c8d0 could not be found. Aug 27 02:29:19.956995 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:29:19.956995 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:29:19.956995 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:29:19.956995 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:29:19.956995 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:29:19.956995 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:29:19.956995 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:29:19.956995 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:29:19.956995 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:29:19.958451 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:29:19.958451 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:29:19.958451 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:29:19.958451 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:29:19.958451 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:29:19.958451 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:29:19.958451 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:29:19.958451 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90b9d290-1aca-4de5-bc22-15f34579c8d0 could not be found. Aug 27 02:29:19.958451 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:29:19.958451 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:29:19.958451 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:29:19.958451 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:29:19.958451 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:29:19.958451 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:29:19.958451 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:29:19.958451 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:29:19.958451 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90b9d290-1aca-4de5-bc22-15f34579c8d0 could not be found. Aug 27 02:29:19.958451 dv-cinder-846303-3-smb devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Aug 27 02:29:19.959996 dv-cinder-846303-3-smb devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-23926403-a429-45dc-8408-f270e001788d tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] Returning 404 to user: Instance 90b9d290-1aca-4de5-bc22-15f34579c8d0 could not be found. {{(pid=120782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:29:19.959996 dv-cinder-846303-3-smb devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-23926403-a429-45dc-8408-f270e001788d tempest-VolumesActionsTest-728668484 tempest-VolumesActionsTest-728668484-project] 10.222.0.61 "GET /compute/v2.1/servers/90b9d290-1aca-4de5-bc22-15f34579c8d0" status: 404 len: 111 microversion: 2.1 time: 0.033952 Aug 27 02:29:19.959996 dv-cinder-846303-3-smb devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 545/1068] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Aug 27 02:29:19 2022] GET /compute/v2.1/servers/90b9d290-1aca-4de5-bc22-15f34579c8d0 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0)